[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:29:46 dist-test-slave-zkpd krb5kdc[26289](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:29:46 dist-test-slave-zkpd krb5kdc[26289](info): set up 2 sockets
Aug 08 08:29:46 dist-test-slave-zkpd krb5kdc[26289](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 08:29:47.601444 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:29:47 dist-test-slave-zkpd krb5kdc[26289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:29:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:29:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:29:47.724896 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:34333
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:34333
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:47.839716 26303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:47.840121 26303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:47.840207 26303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:47.844220 26303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:29:47.844291 26303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:47.844326 26303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:47.844383 26303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:29:47.844419 26303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:29:47.849534 26303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:34333
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:34333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:47.850499 26303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:47.851557 26303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:47.860047 26309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:47.860004 26311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:47.860004 26308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:47.860213 26303 server_base.cc:1034] running on GCE node
I20260808 08:29:47.860870 26303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:47.861970 26303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:47.863159 26303 hybrid_clock.cc:648] HybridClock initialized: now 1786177787863145 us; error 28 us; skew 500 ppm
Aug 08 08:29:47 dist-test-slave-zkpd krb5kdc[26289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177787, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:47.865926 26303 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:29:47.866735 26303 webserver.cc:460] Webserver started at http://127.25.170.62:40775/ using document root <none> and password file <none>
I20260808 08:29:47.867268 26303 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:47.867368 26303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:47.867591 26303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:47.869607 26303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "2f0790c84ee946ca9a9be232dad45623"
format_stamp: "Formatted at 2026-08-08 08:29:47 on dist-test-slave-zkpd"
server_key: "a244db0e0b9a6a956568a050ec401980"
server_key_iv: "b6fe8e851efa6324fb9b02cc5aef4ead"
server_key_version: "encryptionkey@0"
I20260808 08:29:47.870165 26303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "2f0790c84ee946ca9a9be232dad45623"
format_stamp: "Formatted at 2026-08-08 08:29:47 on dist-test-slave-zkpd"
server_key: "a244db0e0b9a6a956568a050ec401980"
server_key_iv: "b6fe8e851efa6324fb9b02cc5aef4ead"
server_key_version: "encryptionkey@0"
I20260808 08:29:47.874455 26303 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:29:47.877154 26319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:47.879027 26303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:29:47.879185 26303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "2f0790c84ee946ca9a9be232dad45623"
format_stamp: "Formatted at 2026-08-08 08:29:47 on dist-test-slave-zkpd"
server_key: "a244db0e0b9a6a956568a050ec401980"
server_key_iv: "b6fe8e851efa6324fb9b02cc5aef4ead"
server_key_version: "encryptionkey@0"
I20260808 08:29:47.879330 26303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:47.892352 26303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:47.894990 26303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:47.895151 26303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:47.903100 26303 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:34333
I20260808 08:29:47.903169 26373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:34333 every 8 connection(s)
I20260808 08:29:47.904054 26303 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:29:47.906796 26374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:47.911882 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 26303
I20260808 08:29:47.912101 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:29:47.912338 26374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623: Bootstrap starting.
I20260808 08:29:47.913419 26280 external_mini_cluster.cc:1428] Setting key 886ef12421b040bf4f428a7ac66a33aa
I20260808 08:29:47.914786 26374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:47.915575 26374 log.cc:824] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:47.917645 26374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623: No bootstrap required, opened a new log
I20260808 08:29:47.921875 26374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f0790c84ee946ca9a9be232dad45623" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34333 } }
I20260808 08:29:47.922138 26374 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:47.922215 26374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f0790c84ee946ca9a9be232dad45623, State: Initialized, Role: FOLLOWER
I20260808 08:29:47.922705 26374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f0790c84ee946ca9a9be232dad45623" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34333 } }
I20260808 08:29:47.922838 26374 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:29:47.922923 26374 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:29:47.923019 26374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:47.923981 26374 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f0790c84ee946ca9a9be232dad45623" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34333 } }
I20260808 08:29:47.924324 26374 leader_election.cc:302] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f0790c84ee946ca9a9be232dad45623; no voters:
I20260808 08:29:47.924623 26374 leader_election.cc:288] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:29:47.924721 26379 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:47.924969 26379 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [term 1 LEADER]: Becoming Leader. State: Replica: 2f0790c84ee946ca9a9be232dad45623, State: Running, Role: LEADER
I20260808 08:29:47.925262 26379 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f0790c84ee946ca9a9be232dad45623" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34333 } }
I20260808 08:29:47.925889 26374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:29:47.926716 26380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f0790c84ee946ca9a9be232dad45623" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f0790c84ee946ca9a9be232dad45623" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34333 } } }
I20260808 08:29:47.926837 26380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [sys.catalog]: This master's current role is: LEADER
I20260808 08:29:47.926870 26381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f0790c84ee946ca9a9be232dad45623. Latest consensus state: current_term: 1 leader_uuid: "2f0790c84ee946ca9a9be232dad45623" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f0790c84ee946ca9a9be232dad45623" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34333 } } }
I20260808 08:29:47.926977 26381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623 [sys.catalog]: This master's current role is: LEADER
I20260808 08:29:47.927522 26388 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:29:47.931130 26388 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 08:29:47 dist-test-slave-zkpd krb5kdc[26289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:47.937318 26388 catalog_manager.cc:1347] Generated new cluster ID: 7332c71aedda4ac39a97c3dcd5dff436
I20260808 08:29:47.937427 26388 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:29:47.940387 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:47.916433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44144 (local address 127.25.170.62:34333)
0808 08:29:47.916885 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:47.916905 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:47.918152 (+ 1247us) server_negotiation.cc:407] Connection header received
0808 08:29:47.921436 (+ 3284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:47.921458 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:47.921826 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:47.922171 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:47.924932 (+ 2761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:47.926547 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:47.928328 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:47.929045 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:47.929207 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:47.934292 (+ 5085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:47.934298 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:47.934310 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:47.934337 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:47.936474 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:47.937157 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:47.937163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:47.937169 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:47.937316 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:47.937733 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:47.937737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:47.937738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:47.938249 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:47.938507 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:47.939168 (+ 661us) server_negotiation.cc:299] Negotiation successful
0808 08:29:47.939433 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":121,"threads_started":1}
I20260808 08:29:47.962054 26388 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:29:47.963260 26388 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:29:47.974398 26388 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f0790c84ee946ca9a9be232dad45623: Generated new TSK 0
I20260808 08:29:47.975232 26388 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:29:48.007092 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34333
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:48.132092 26400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:48.132349 26400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:48.132439 26400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:48.136896 26400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:48.136946 26400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:48.137001 26400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:29:48.142191 26400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34333
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:48.143288 26400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:48.144352 26400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:48.154078 26405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:48.154088 26406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:48.154089 26408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:48.154167 26400 server_base.cc:1034] running on GCE node
I20260808 08:29:48.154744 26400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:48.155405 26400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:48.156594 26400 hybrid_clock.cc:648] HybridClock initialized: now 1786177788156575 us; error 30 us; skew 500 ppm
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177788, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:48.159384 26400 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:29:48.160319 26400 webserver.cc:460] Webserver started at http://127.25.170.1:39237/ using document root <none> and password file <none>
I20260808 08:29:48.160856 26400 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:48.160917 26400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:48.161079 26400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:48.163050 26400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "442e943294b54c909e8d1fe0dac516a1"
format_stamp: "Formatted at 2026-08-08 08:29:48 on dist-test-slave-zkpd"
server_key: "3ba3beab9460b7f4edb90ed0bf7e98e2"
server_key_iv: "757dbc7bf03f0eaa40cb1f7d80fc41a3"
server_key_version: "encryptionkey@0"
I20260808 08:29:48.163609 26400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "442e943294b54c909e8d1fe0dac516a1"
format_stamp: "Formatted at 2026-08-08 08:29:48 on dist-test-slave-zkpd"
server_key: "3ba3beab9460b7f4edb90ed0bf7e98e2"
server_key_iv: "757dbc7bf03f0eaa40cb1f7d80fc41a3"
server_key_version: "encryptionkey@0"
I20260808 08:29:48.167228 26400 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:29:48.169574 26416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:48.170780 26400 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260808 08:29:48.170905 26400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "442e943294b54c909e8d1fe0dac516a1"
format_stamp: "Formatted at 2026-08-08 08:29:48 on dist-test-slave-zkpd"
server_key: "3ba3beab9460b7f4edb90ed0bf7e98e2"
server_key_iv: "757dbc7bf03f0eaa40cb1f7d80fc41a3"
server_key_version: "encryptionkey@0"
I20260808 08:29:48.171008 26400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:48.195339 26400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:48.198396 26400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:48.198622 26400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:48.199308 26400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:29:48.200241 26400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:48.200289 26400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:48.200359 26400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:48.200390 26400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:48.211583 26400 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:39879
I20260808 08:29:48.211611 26532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:39879 every 8 connection(s)
I20260808 08:29:48.212566 26400 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:29:48.213934 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 26400
I20260808 08:29:48.214061 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:29:48.214316 26280 external_mini_cluster.cc:1428] Setting key 11899481be4a9ddec79324fa9554b2c8
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177788, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:29:48.227276 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:48.214640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:51341 (local address 127.25.170.62:34333)
0808 08:29:48.214817 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:48.214821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:48.216105 (+ 1284us) server_negotiation.cc:407] Connection header received
0808 08:29:48.217067 (+ 962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:48.217073 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:48.217138 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:48.217229 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:48.218474 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.219013 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.220290 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.220543 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.220660 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:48.223259 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:48.223264 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:48.223266 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:48.223298 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:48.224971 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:48.225598 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:48.225603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:48.225605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:48.225689 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:48.226046 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:48.226050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:48.226052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:48.226279 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:48.226399 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:48.226914 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 08:29:48.227124 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:29:48.228325 26535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:48.215113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:34333 (local address 127.25.170.1:51341)
0808 08:29:48.215946 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:48.216002 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:48.216863 (+ 861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:48.217388 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:48.217394 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:48.217789 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:48.218317 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:48.218330 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.219143 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.219146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:48.220164 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:48.220174 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.220697 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.220701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:48.220874 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:48.221599 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:48.221615 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:48.223094 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:48.225096 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:48.225101 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:48.225116 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:48.225494 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:48.225784 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:48.225788 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:48.225790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:48.225957 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:48.226417 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:48.226423 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:48.226655 (+ 232us) client_negotiation.cc:769] Sending connection context
0808 08:29:48.226822 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 08:29:48.227225 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":158,"threads_started":1}
I20260808 08:29:48.229841 26533 heartbeater.cc:347] Connected to a master server at 127.25.170.62:34333
I20260808 08:29:48.230100 26533 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:48.230631 26533 heartbeater.cc:511] Master 127.25.170.62:34333 requested a full tablet report, sending...
I20260808 08:29:48.232184 26337 ts_manager.cc:194] Registered new tserver with Master: 442e943294b54c909e8d1fe0dac516a1 (127.25.170.1:39879)
I20260808 08:29:48.233322 26337 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:51341
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:29:48.243752 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34333
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:48.367439 26538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:48.367663 26538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:48.367708 26538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:48.371659 26538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:48.371712 26538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:48.371801 26538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:29:48.377182 26538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34333
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:48.378274 26538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:48.379284 26538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:48.389061 26544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:48.389207 26546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:48.389056 26543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:48.389410 26538 server_base.cc:1034] running on GCE node
I20260808 08:29:48.389787 26538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:48.390422 26538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:48.391610 26538 hybrid_clock.cc:648] HybridClock initialized: now 1786177788391578 us; error 54 us; skew 500 ppm
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177788, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:48.394557 26538 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:29:48.395380 26538 webserver.cc:460] Webserver started at http://127.25.170.2:37347/ using document root <none> and password file <none>
I20260808 08:29:48.395977 26538 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:48.396042 26538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:48.396251 26538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:48.398464 26538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "09d2751307734bff96939f01bb81ea68"
format_stamp: "Formatted at 2026-08-08 08:29:48 on dist-test-slave-zkpd"
server_key: "aa1bff6b2d51d584efcaa7d9e6955612"
server_key_iv: "852800cacbf13a990c17335072d4826b"
server_key_version: "encryptionkey@0"
I20260808 08:29:48.399039 26538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "09d2751307734bff96939f01bb81ea68"
format_stamp: "Formatted at 2026-08-08 08:29:48 on dist-test-slave-zkpd"
server_key: "aa1bff6b2d51d584efcaa7d9e6955612"
server_key_iv: "852800cacbf13a990c17335072d4826b"
server_key_version: "encryptionkey@0"
I20260808 08:29:48.402983 26538 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 08:29:48.405627 26553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:48.406980 26538 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:29:48.407128 26538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "09d2751307734bff96939f01bb81ea68"
format_stamp: "Formatted at 2026-08-08 08:29:48 on dist-test-slave-zkpd"
server_key: "aa1bff6b2d51d584efcaa7d9e6955612"
server_key_iv: "852800cacbf13a990c17335072d4826b"
server_key_version: "encryptionkey@0"
I20260808 08:29:48.407251 26538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:48.418936 26538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:48.422060 26538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:48.422261 26538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:48.422840 26538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:29:48.423697 26538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:48.423765 26538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:48.423853 26538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:48.423923 26538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260808 08:29:48.436789 26538 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:41117
I20260808 08:29:48.436913 26672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:41117 every 8 connection(s)
I20260808 08:29:48.437749 26538 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:29:48.440047 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 26538
I20260808 08:29:48.440189 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:29:48.440562 26280 external_mini_cluster.cc:1428] Setting key 8031d541077bffaec5e08df3ccbf7c38
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177788, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:48.453248 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:48.439859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:60713 (local address 127.25.170.62:34333)
0808 08:29:48.440026 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:48.440031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:48.441206 (+ 1175us) server_negotiation.cc:407] Connection header received
0808 08:29:48.442454 (+ 1248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:48.442458 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:48.442514 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:48.442591 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:48.443724 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.444345 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.446152 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.446637 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.446797 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:48.449600 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:48.449604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:48.449607 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:48.449632 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:48.451119 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:48.451628 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:48.451632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:48.451634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:48.451714 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:48.452149 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:48.452152 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:48.452154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:48.452340 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:48.452450 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:48.452957 (+ 507us) server_negotiation.cc:299] Negotiation successful
0808 08:29:48.453079 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:29:48.454181 26675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:48.440258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:34333 (local address 127.25.170.2:60713)
0808 08:29:48.441059 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:48.441111 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:48.442229 (+ 1118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:48.442759 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:48.442765 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:48.443113 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:48.443576 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:48.443590 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.444476 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.444480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:48.445994 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:48.446008 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.446854 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.446857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:48.447225 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:48.447884 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:48.447945 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:48.449432 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:48.451245 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:48.451250 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:48.451264 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:48.451520 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:48.451816 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:48.451819 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:48.451821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:48.452042 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:48.452451 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:48.452458 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:48.452714 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 08:29:48.452899 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 08:29:48.453212 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":203,"threads_started":1}
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:29:48.455440 26673 heartbeater.cc:347] Connected to a master server at 127.25.170.62:34333
I20260808 08:29:48.455732 26673 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:48.456416 26673 heartbeater.cc:511] Master 127.25.170.62:34333 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
I20260808 08:29:48.457718 26337 ts_manager.cc:194] Registered new tserver with Master: 09d2751307734bff96939f01bb81ea68 (127.25.170.2:41117)
I20260808 08:29:48.458654 26337 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:60713
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:29:48.473187 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34333
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:48.615842 26678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:48.616106 26678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:48.616149 26678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:48.620157 26678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:48.620208 26678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:48.620266 26678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:29:48.625469 26678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34333
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:48.626456 26678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:48.627535 26678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:48.637691 26686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:48.637692 26684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:48.637713 26683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:48.637982 26678 server_base.cc:1034] running on GCE node
I20260808 08:29:48.638458 26678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:48.639081 26678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:48.640270 26678 hybrid_clock.cc:648] HybridClock initialized: now 1786177788640234 us; error 45 us; skew 500 ppm
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177788, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:48.642925 26678 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:29:48.643744 26678 webserver.cc:460] Webserver started at http://127.25.170.3:35039/ using document root <none> and password file <none>
I20260808 08:29:48.644349 26678 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:48.644438 26678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:48.644660 26678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:48.646652 26678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "2e639440651747cbb748da409cb7553a"
format_stamp: "Formatted at 2026-08-08 08:29:48 on dist-test-slave-zkpd"
server_key: "513a81761b94dc617c9ecdab713ba3a1"
server_key_iv: "8644813b4172522099a9292a2e5cc848"
server_key_version: "encryptionkey@0"
I20260808 08:29:48.647209 26678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "2e639440651747cbb748da409cb7553a"
format_stamp: "Formatted at 2026-08-08 08:29:48 on dist-test-slave-zkpd"
server_key: "513a81761b94dc617c9ecdab713ba3a1"
server_key_iv: "8644813b4172522099a9292a2e5cc848"
server_key_version: "encryptionkey@0"
I20260808 08:29:48.650921 26678 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:29:48.653262 26693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:48.654452 26678 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:29:48.654582 26678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "2e639440651747cbb748da409cb7553a"
format_stamp: "Formatted at 2026-08-08 08:29:48 on dist-test-slave-zkpd"
server_key: "513a81761b94dc617c9ecdab713ba3a1"
server_key_iv: "8644813b4172522099a9292a2e5cc848"
server_key_version: "encryptionkey@0"
I20260808 08:29:48.654690 26678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:48.665967 26678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:48.668802 26678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:48.669039 26678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:48.669618 26678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:29:48.670513 26678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:48.670581 26678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:48.670651 26678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:48.670691 26678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:48.680773 26678 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:45519
I20260808 08:29:48.680796 26815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:45519 every 8 connection(s)
I20260808 08:29:48.681632 26678 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:29:48.690555 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 26678
I20260808 08:29:48.690694 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:29:48.690960 26280 external_mini_cluster.cc:1428] Setting key 7b10ab5c31bef64b56b4e7815b11898b
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177788, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:48.695947 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:48.683396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:34147 (local address 127.25.170.62:34333)
0808 08:29:48.683528 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:48.683532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:48.684837 (+ 1305us) server_negotiation.cc:407] Connection header received
0808 08:29:48.685727 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:48.685730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:48.685801 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:48.685876 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:48.686991 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.687489 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.689104 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.689320 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.689403 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:48.692369 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:48.692372 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:48.692374 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:48.692398 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:48.694106 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:48.694609 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:48.694611 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:48.694612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:48.694687 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:48.694999 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:48.695002 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:48.695003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:48.695173 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:48.695247 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:48.695682 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 08:29:48.695773 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:29:48.696748 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:48.683758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:34333 (local address 127.25.170.3:34147)
0808 08:29:48.684674 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:48.684714 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:48.685545 (+ 831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:48.686031 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:48.686037 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:48.686371 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:48.686850 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:48.686862 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.687593 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.687596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:48.688981 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:48.688996 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.689474 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.689481 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:48.689705 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:48.690323 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:48.690349 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:48.692195 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:48.694230 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:48.694243 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:48.694255 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:48.694510 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:48.694780 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:48.694782 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:48.694783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:48.694912 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:48.695258 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:48.695263 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:48.695477 (+ 214us) client_negotiation.cc:769] Sending connection context
0808 08:29:48.695619 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 08:29:48.695861 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":548,"threads_started":1}
I20260808 08:29:48.697785 26816 heartbeater.cc:347] Connected to a master server at 127.25.170.62:34333
I20260808 08:29:48.698014 26816 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:48.698482 26816 heartbeater.cc:511] Master 127.25.170.62:34333 requested a full tablet report, sending...
I20260808 08:29:48.699465 26337 ts_manager.cc:194] Registered new tserver with Master: 2e639440651747cbb748da409cb7553a (127.25.170.3:45519)
I20260808 08:29:48.700058 26337 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:34147
I20260808 08:29:48.705506 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177788, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177788, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:29:48.732642 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:48.723296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60108 (local address 127.25.170.1:39879)
0808 08:29:48.723620 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:48.723643 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:48.723667 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:29:48.723717 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:48.723722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:48.723992 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:48.724127 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:48.724907 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.725758 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.726710 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.727171 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.727257 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:48.729580 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:48.729589 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:48.729603 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:48.729628 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:48.731059 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:48.731444 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:48.731448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:48.731450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:48.731526 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:48.731749 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:48.731751 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:48.731752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:48.732060 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:48.732216 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:48.732385 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 08:29:48.732506 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":134,"threads_started":1}
W20260808 08:29:48.733587 26446 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60108
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:29:48.759336 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:48.751421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60116 (local address 127.25.170.1:39879)
0808 08:29:48.751552 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:48.751556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:48.751722 (+ 166us) server_negotiation.cc:407] Connection header received
0808 08:29:48.751835 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:48.751838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:48.751882 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:48.752007 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:48.752631 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.753111 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.753902 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:48.754108 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:48.754180 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:48.756515 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:48.756518 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:48.756520 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:48.756543 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:48.757770 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:48.758197 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:48.758208 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:48.758209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:48.758282 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:48.758511 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:48.758512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:48.758514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:48.758652 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:48.758786 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:48.758986 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 08:29:48.759120 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:29:48.760399 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 26400
I20260808 08:29:48.769718 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 26538
I20260808 08:29:48.776908 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 26678
I20260808 08:29:48.783221 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 26303
2026-08-08T08:29:48Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2271 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26831](info): set up 2 sockets
Aug 08 08:29:48 dist-test-slave-zkpd krb5kdc[26831](info): commencing operation
krb5kdc: starting...
W20260808 08:29:49.861586 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:29:49 dist-test-slave-zkpd krb5kdc[26831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:29:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:29:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:29:49.980810 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:35619
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:46277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:35619
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:50.091681 26845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:50.092075 26845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:50.092166 26845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:50.096225 26845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:29:50.096316 26845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:50.096356 26845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:50.096393 26845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:29:50.096426 26845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:29:50.101689 26845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:35619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:35619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:50.102869 26845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:50.103933 26845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:50.112619 26851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:50.112612 26850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:50.112632 26853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:50.112948 26845 server_base.cc:1034] running on GCE node
I20260808 08:29:50.113535 26845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:50.114683 26845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:50.115868 26845 hybrid_clock.cc:648] HybridClock initialized: now 1786177790115829 us; error 50 us; skew 500 ppm
Aug 08 08:29:50 dist-test-slave-zkpd krb5kdc[26831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:50.118836 26845 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:29:50.119803 26845 webserver.cc:460] Webserver started at http://127.25.170.62:33437/ using document root <none> and password file <none>
I20260808 08:29:50.120401 26845 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:50.120496 26845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:50.120744 26845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:50.122838 26845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "511fe8232c434805bf7fe78d575886e1"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "33b82f33cd6c2e2d98a2d8629751fc15"
server_key_iv: "5ecd9bd331d2a4493ff74f10246af412"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.123432 26845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "511fe8232c434805bf7fe78d575886e1"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "33b82f33cd6c2e2d98a2d8629751fc15"
server_key_iv: "5ecd9bd331d2a4493ff74f10246af412"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.127400 26845 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 08:29:50.130308 26860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:50.131564 26845 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:29:50.131747 26845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "511fe8232c434805bf7fe78d575886e1"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "33b82f33cd6c2e2d98a2d8629751fc15"
server_key_iv: "5ecd9bd331d2a4493ff74f10246af412"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.131867 26845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:50.149892 26845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:50.152915 26845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:50.153133 26845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:50.160493 26845 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:35619
I20260808 08:29:50.160507 26915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:35619 every 8 connection(s)
I20260808 08:29:50.161453 26845 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:29:50.164340 26916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:50.167219 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 26845
I20260808 08:29:50.167357 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:29:50.167659 26280 external_mini_cluster.cc:1428] Setting key 19920519e7460407b288f248bd7bd63f
I20260808 08:29:50.170588 26916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1: Bootstrap starting.
I20260808 08:29:50.173225 26916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:50.174149 26916 log.cc:824] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:50.176616 26916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1: No bootstrap required, opened a new log
Aug 08 08:29:50 dist-test-slave-zkpd krb5kdc[26831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:50.180768 26916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511fe8232c434805bf7fe78d575886e1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35619 } }
I20260808 08:29:50.181066 26916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:50.181129 26916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511fe8232c434805bf7fe78d575886e1, State: Initialized, Role: FOLLOWER
I20260808 08:29:50.181643 26916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511fe8232c434805bf7fe78d575886e1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35619 } }
I20260808 08:29:50.181846 26916 raft_consensus.cc:388] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:29:50.181921 26916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:29:50.182020 26916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:50.183169 26916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511fe8232c434805bf7fe78d575886e1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35619 } }
I20260808 08:29:50.183544 26916 leader_election.cc:302] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 511fe8232c434805bf7fe78d575886e1; no voters:
I20260808 08:29:50.183863 26916 leader_election.cc:288] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:29:50.184048 26921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:50.184094 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.169107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57556 (local address 127.25.170.62:35619)
0808 08:29:50.169565 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:50.169582 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:50.169619 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:29:50.170289 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:50.170306 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:50.170659 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:50.171010 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:50.171951 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.173060 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.174274 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.174988 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.175125 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.177981 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:50.177988 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:50.178005 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:50.178037 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:50.180770 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:50.181280 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:50.181286 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:50.181292 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:50.181431 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:50.181716 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:50.181719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:50.181721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:50.182267 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:50.182457 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:50.182736 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 08:29:50.183063 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":154,"threads_started":1}
I20260808 08:29:50.184300 26921 raft_consensus.cc:686] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [term 1 LEADER]: Becoming Leader. State: Replica: 511fe8232c434805bf7fe78d575886e1, State: Running, Role: LEADER
I20260808 08:29:50.184623 26921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511fe8232c434805bf7fe78d575886e1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35619 } }
I20260808 08:29:50.185066 26916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:29:50.185936 26923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 511fe8232c434805bf7fe78d575886e1. Latest consensus state: current_term: 1 leader_uuid: "511fe8232c434805bf7fe78d575886e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511fe8232c434805bf7fe78d575886e1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35619 } } }
I20260808 08:29:50.186079 26923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:29:50.186822 26922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "511fe8232c434805bf7fe78d575886e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511fe8232c434805bf7fe78d575886e1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35619 } } }
I20260808 08:29:50.186955 26922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1 [sys.catalog]: This master's current role is: LEADER
W20260808 08:29:50.190078 26937 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:29:50.190160 26937 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:29:50.190238 26930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:29:50.191123 26930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:29:50.197012 26930 catalog_manager.cc:1347] Generated new cluster ID: c43bec63a39347e68fccc3b03a529193
I20260808 08:29:50.197095 26930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:29:50.215250 26930 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:29:50.216375 26930 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:29:50.222222 26930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 511fe8232c434805bf7fe78d575886e1: Generated new TSK 0
I20260808 08:29:50.222956 26930 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:29:50.257134 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35619
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:46277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:50.372720 26943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:50.372991 26943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:50.373070 26943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:50.377164 26943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:50.377226 26943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:50.377317 26943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:29:50.382652 26943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35619
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:50.383783 26943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:50.384938 26943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:50.394794 26949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:50.394842 26948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:50.394827 26951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:50.394987 26943 server_base.cc:1034] running on GCE node
I20260808 08:29:50.395411 26943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:50.396121 26943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:50.397331 26943 hybrid_clock.cc:648] HybridClock initialized: now 1786177790397313 us; error 27 us; skew 500 ppm
Aug 08 08:29:50 dist-test-slave-zkpd krb5kdc[26831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:50.400297 26943 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:29:50.401232 26943 webserver.cc:460] Webserver started at http://127.25.170.1:42275/ using document root <none> and password file <none>
I20260808 08:29:50.401873 26943 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:50.401983 26943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:50.402238 26943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:50.404598 26943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "d5fdb8cdafac46f79c5d063a2d0263ad"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "182c6366b89585708031d099bf499eb8"
server_key_iv: "3fdf66670cda51fe9ac79f43791831cd"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.405232 26943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "d5fdb8cdafac46f79c5d063a2d0263ad"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "182c6366b89585708031d099bf499eb8"
server_key_iv: "3fdf66670cda51fe9ac79f43791831cd"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.409426 26943 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:29:50.412258 26958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:50.413744 26943 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:29:50.413892 26943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "d5fdb8cdafac46f79c5d063a2d0263ad"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "182c6366b89585708031d099bf499eb8"
server_key_iv: "3fdf66670cda51fe9ac79f43791831cd"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.414012 26943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:50.437919 26943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:50.441115 26943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:50.441363 26943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:50.442034 26943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:29:50.442946 26943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:50.443024 26943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:50.443135 26943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:50.443192 26943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:50.452857 26943 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:46769
I20260808 08:29:50.452886 27075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:46769 every 8 connection(s)
I20260808 08:29:50.453826 26943 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:29:50.454160 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 26943
I20260808 08:29:50.454275 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:29:50.454581 26280 external_mini_cluster.cc:1428] Setting key 3206494c92bfaf5aaa1bfab39563b492
Aug 08 08:29:50 dist-test-slave-zkpd krb5kdc[26831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:29:50.468712 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.455841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:55781 (local address 127.25.170.62:35619)
0808 08:29:50.456002 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:50.456007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:50.457135 (+ 1128us) server_negotiation.cc:407] Connection header received
0808 08:29:50.458889 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:50.458892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:50.458948 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:50.459052 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:50.460273 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.460797 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.462021 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.462272 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.462395 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.464893 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:50.464900 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:50.464906 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:50.464943 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:50.466513 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:50.467011 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:50.467015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:50.467016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:50.467103 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:50.467469 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:50.467472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:50.467473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:50.467672 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:50.467765 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:50.468441 (+ 676us) server_negotiation.cc:299] Negotiation successful
0808 08:29:50.468572 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:29:50.469909 27079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.456392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:35619 (local address 127.25.170.1:55781)
0808 08:29:50.456944 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:50.457004 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:50.458673 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:50.459228 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:50.459235 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:50.459593 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:50.460123 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.460138 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.460949 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.460956 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.461892 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.461903 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.462435 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.462440 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.462611 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.463205 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:50.463221 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:50.464705 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:50.466624 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:50.466629 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:50.466640 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:50.466893 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:50.467185 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:50.467187 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:50.467188 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:50.467331 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:50.467775 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:50.467780 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:50.468129 (+ 349us) client_negotiation.cc:769] Sending connection context
0808 08:29:50.468341 (+ 212us) client_negotiation.cc:240] Negotiation successful
0808 08:29:50.468690 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":125,"threads_started":1}
I20260808 08:29:50.471257 27076 heartbeater.cc:347] Connected to a master server at 127.25.170.62:35619
I20260808 08:29:50.471521 27076 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:50.472064 27076 heartbeater.cc:511] Master 127.25.170.62:35619 requested a full tablet report, sending...
I20260808 08:29:50.473842 26878 ts_manager.cc:194] Registered new tserver with Master: d5fdb8cdafac46f79c5d063a2d0263ad (127.25.170.1:46769)
I20260808 08:29:50.475679 26878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:55781
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:29:50.486451 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35619
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:46277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:50.604182 27082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:50.604414 27082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:50.604463 27082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:50.608325 27082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:50.608381 27082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:50.608436 27082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:29:50.613561 27082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35619
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:50.614513 27082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:50.615468 27082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:50.625123 27090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:50.625126 27087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:50.625213 27088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:50.625542 27082 server_base.cc:1034] running on GCE node
I20260808 08:29:50.625968 27082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:50.626577 27082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:50.627761 27082 hybrid_clock.cc:648] HybridClock initialized: now 1786177790627734 us; error 35 us; skew 500 ppm
Aug 08 08:29:50 dist-test-slave-zkpd krb5kdc[26831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:50.630595 27082 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:29:50.631490 27082 webserver.cc:460] Webserver started at http://127.25.170.2:33581/ using document root <none> and password file <none>
I20260808 08:29:50.632120 27082 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:50.632213 27082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:50.632493 27082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:50.634557 27082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "b02665c6b8b344579e216f35905d07a7"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "45d671c75dfd8a43831a65aaacea3d85"
server_key_iv: "5afa75b72813b2391e616a711d273013"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.635162 27082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "b02665c6b8b344579e216f35905d07a7"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "45d671c75dfd8a43831a65aaacea3d85"
server_key_iv: "5afa75b72813b2391e616a711d273013"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.639068 27082 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 08:29:50.641566 27098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:50.642844 27082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:29:50.642983 27082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "b02665c6b8b344579e216f35905d07a7"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "45d671c75dfd8a43831a65aaacea3d85"
server_key_iv: "5afa75b72813b2391e616a711d273013"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.643095 27082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:50.675792 27082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:50.678745 27082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:50.678961 27082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:50.679575 27082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:29:50.680585 27082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:50.680657 27082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:50.680740 27082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:50.680794 27082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:50.690491 27082 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:36433
I20260808 08:29:50.690522 27216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:36433 every 8 connection(s)
I20260808 08:29:50.691394 27082 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:29:50.693075 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 27082
I20260808 08:29:50.693183 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:29:50.693471 26280 external_mini_cluster.cc:1428] Setting key 6ffc5bed77d7a069a9304f8086c017af
Aug 08 08:29:50 dist-test-slave-zkpd krb5kdc[26831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:29:50.707322 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.693206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:59543 (local address 127.25.170.62:35619)
0808 08:29:50.693349 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:50.693353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:50.694446 (+ 1093us) server_negotiation.cc:407] Connection header received
0808 08:29:50.696256 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:50.696259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:50.696308 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:50.696376 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:50.697872 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.698723 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.699906 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.700346 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.700463 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.703349 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:50.703356 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:50.703361 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:50.703398 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:50.705173 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:50.705680 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:50.705683 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:50.705685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:50.705764 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:50.706172 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:50.706174 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:50.706175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:50.706353 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:50.706431 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:50.707069 (+ 638us) server_negotiation.cc:299] Negotiation successful
0808 08:29:50.707200 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
I20260808 08:29:50.708271 27219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.693747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:35619 (local address 127.25.170.2:59543)
0808 08:29:50.694288 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:50.694340 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:50.696025 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:50.696558 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:50.696571 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:50.697090 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:50.697702 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.697718 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.698878 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.698881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.699756 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.699766 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.700536 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.700540 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.700697 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.701408 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:50.701425 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:50.703141 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:50.705287 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:50.705292 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:50.705304 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:50.705566 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:50.705879 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:50.705881 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:50.705883 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:50.706070 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:50.706466 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:50.706472 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:50.706703 (+ 231us) client_negotiation.cc:769] Sending connection context
0808 08:29:50.706873 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 08:29:50.707127 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":158,"threads_started":1}
I20260808 08:29:50.710893 27217 heartbeater.cc:347] Connected to a master server at 127.25.170.62:35619
I20260808 08:29:50.711158 27217 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:50.711669 27217 heartbeater.cc:511] Master 127.25.170.62:35619 requested a full tablet report, sending...
I20260808 08:29:50.712899 26878 ts_manager.cc:194] Registered new tserver with Master: b02665c6b8b344579e216f35905d07a7 (127.25.170.2:36433)
I20260808 08:29:50.713799 26878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:59543
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:29:50.725172 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35619
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:46277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:50.840539 27223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:50.840797 27223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:50.840878 27223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:50.845891 27223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:50.845966 27223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:50.846058 27223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:29:50.851287 27223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35619
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:50.852264 27223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:50.853190 27223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:50.862727 27228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:50.862727 27229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:50.862744 27231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:50.862805 27223 server_base.cc:1034] running on GCE node
I20260808 08:29:50.863322 27223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:50.863962 27223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:50.865126 27223 hybrid_clock.cc:648] HybridClock initialized: now 1786177790865090 us; error 49 us; skew 500 ppm
Aug 08 08:29:50 dist-test-slave-zkpd krb5kdc[26831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:50.868044 27223 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:29:50.868817 27223 webserver.cc:460] Webserver started at http://127.25.170.3:43993/ using document root <none> and password file <none>
I20260808 08:29:50.869315 27223 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:50.869372 27223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:50.869532 27223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:50.871475 27223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "782fc87af97747c68ca4e7813f6f1198"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "158c022e591c4a2d4f482713020e379a"
server_key_iv: "a4d215dffce2d855d0ee638f071e5997"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.872061 27223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "782fc87af97747c68ca4e7813f6f1198"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "158c022e591c4a2d4f482713020e379a"
server_key_iv: "a4d215dffce2d855d0ee638f071e5997"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.876020 27223 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:29:50.878314 27239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:50.879483 27223 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:29:50.879586 27223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "782fc87af97747c68ca4e7813f6f1198"
format_stamp: "Formatted at 2026-08-08 08:29:50 on dist-test-slave-zkpd"
server_key: "158c022e591c4a2d4f482713020e379a"
server_key_iv: "a4d215dffce2d855d0ee638f071e5997"
server_key_version: "encryptionkey@0"
I20260808 08:29:50.879665 27223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:50.891762 27223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:50.894573 27223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:50.894791 27223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:50.895392 27223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:29:50.896258 27223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:50.896311 27223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:50.896399 27223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:50.896436 27223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:50.906745 27223 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:45975
I20260808 08:29:50.906816 27354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:45975 every 8 connection(s)
I20260808 08:29:50.907661 27223 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:29:50.911448 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 27223
I20260808 08:29:50.911564 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:29:50.911850 26280 external_mini_cluster.cc:1428] Setting key 3fa628047336600765620d3928241db0
Aug 08 08:29:50 dist-test-slave-zkpd krb5kdc[26831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177790, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:50.921773 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.909532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:60481 (local address 127.25.170.62:35619)
0808 08:29:50.909683 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:50.909687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:50.910626 (+ 939us) server_negotiation.cc:407] Connection header received
0808 08:29:50.912332 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:50.912335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:50.912395 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:50.912509 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:50.913791 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.914329 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.915548 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.915777 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.915885 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.918318 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:50.918322 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:50.918325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:50.918356 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:50.919745 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:50.920286 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:50.920290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:50.920291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:50.920375 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:50.920725 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:50.920729 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:50.920730 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:50.920906 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:50.921013 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:50.921490 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 08:29:50.921608 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:29:50.922483 27357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.909998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:35619 (local address 127.25.170.3:60481)
0808 08:29:50.910477 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:50.910521 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:50.912086 (+ 1565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:50.912681 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:50.912688 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:50.913160 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:50.913630 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.913643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.914458 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.914462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.915421 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.915431 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.915962 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.915967 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.916134 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.916642 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:50.916658 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:50.918157 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:50.919875 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:50.919880 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:50.919896 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:50.920176 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:50.920478 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:50.920481 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:50.920483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:50.920620 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:50.921027 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:50.921034 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:50.921258 (+ 224us) client_negotiation.cc:769] Sending connection context
0808 08:29:50.921430 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 08:29:50.921733 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":108,"threads_started":1}
I20260808 08:29:50.923520 27355 heartbeater.cc:347] Connected to a master server at 127.25.170.62:35619
I20260808 08:29:50.923727 27355 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:50.924203 27355 heartbeater.cc:511] Master 127.25.170.62:35619 requested a full tablet report, sending...
I20260808 08:29:50.925227 26878 ts_manager.cc:194] Registered new tserver with Master: 782fc87af97747c68ca4e7813f6f1198 (127.25.170.3:45975)
I20260808 08:29:50.925837 26878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:60481
I20260808 08:29:50.937232 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:29:50.947477 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.940536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54204 (local address 127.25.170.62:35619)
0808 08:29:50.940653 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:50.940656 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:50.940891 (+ 235us) server_negotiation.cc:407] Connection header received
0808 08:29:50.940986 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:50.940989 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:50.941025 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:50.941090 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:50.941757 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.942236 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.943056 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.943256 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.943330 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.944584 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:50.944587 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:50.944589 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:50.944610 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:50.945859 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:50.946317 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:50.946320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:50.946321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:50.946410 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:50.946640 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:50.946642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:50.946643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:50.946851 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:50.946952 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:50.947211 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 08:29:50.947345 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:29:50.952008 26878 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54204:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:29:50.954947 26878 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:29:50.969599 27368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.963218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:36433 (local address 127.0.0.1:40726)
0808 08:29:50.963745 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:50.963797 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:50.963961 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:50.964845 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:50.964851 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:50.964875 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:50.965014 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.965020 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.966545 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.966548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.968008 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.968019 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.969023 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.969027 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.969152 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.969199 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 08:29:50.969336 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 08:29:50.969423 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":29,"thread_start_us":74,"threads_started":1}
I20260808 08:29:50.969796 27372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.964856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.25.170.1:46769)
0808 08:29:50.965176 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:50.965189 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:50.965210 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:29:50.965299 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:50.965303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:50.965488 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:50.965639 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:50.965933 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.966829 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.968380 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.969155 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.969295 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.969439 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:50.969561 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 08:29:50.969664 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":140,"threads_started":1}
I20260808 08:29:50.970187 27371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.964434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47040 (local address 127.25.170.3:45975)
0808 08:29:50.964862 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:50.964874 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:50.964897 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:29:50.964968 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:50.964975 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:50.965163 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:50.965319 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:50.965566 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.966642 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.968129 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.968942 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.969676 (+ 734us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.969827 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:50.969884 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 08:29:50.970008 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":150,"threads_started":1}
I20260808 08:29:50.970407 27369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.963381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40726 (local address 127.25.170.2:36433)
0808 08:29:50.963855 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:50.963868 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:50.963916 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:29:50.964193 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:50.964200 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:50.964444 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:50.964620 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:50.965150 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.966400 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.968154 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.968882 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.969011 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.969171 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:50.970040 (+ 869us) server_negotiation.cc:299] Negotiation successful
0808 08:29:50.970146 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":109,"threads_started":1}
I20260808 08:29:50.969601 27367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.963355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:45975 (local address 127.0.0.1:47040)
0808 08:29:50.964049 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:50.964067 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:50.964152 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:50.965307 (+ 1155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:50.965310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:50.965329 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:50.965438 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.965444 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.966788 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.966791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.968012 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.968023 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.969090 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.969095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.969187 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.969225 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:29:50.969290 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 08:29:50.969415 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"mutex_wait_us":101,"thread_start_us":106,"threads_started":1}
I20260808 08:29:50.969794 27370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:50.963945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:46769 (local address 127.0.0.1:44058)
0808 08:29:50.964489 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:50.964502 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:50.964588 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:50.965608 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:50.965610 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:50.965628 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:50.965804 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.965813 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.966991 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.966994 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.968244 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:50.968254 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:50.969316 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:50.969322 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:50.969426 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:50.969446 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 08:29:50.969515 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 08:29:50.969572 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":60,"thread_start_us":130,"threads_started":1}
I20260808 08:29:50.973315 27287 tablet_service.cc:1467] Processing CreateTablet for tablet 4a36e86ee751451aa6227404af76536c (DEFAULT_TABLE table=test-table [id=9d36e62e334b4f1b9cef21330c170156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:50.973527 27008 tablet_service.cc:1467] Processing CreateTablet for tablet 4a36e86ee751451aa6227404af76536c (DEFAULT_TABLE table=test-table [id=9d36e62e334b4f1b9cef21330c170156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:50.973482 27147 tablet_service.cc:1467] Processing CreateTablet for tablet 4a36e86ee751451aa6227404af76536c (DEFAULT_TABLE table=test-table [id=9d36e62e334b4f1b9cef21330c170156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:50.974407 27287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a36e86ee751451aa6227404af76536c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:50.974591 27008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a36e86ee751451aa6227404af76536c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:50.974591 27147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a36e86ee751451aa6227404af76536c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:50.980444 27373 tablet_bootstrap.cc:492] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198: Bootstrap starting.
I20260808 08:29:50.982515 27375 tablet_bootstrap.cc:492] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad: Bootstrap starting.
I20260808 08:29:50.982913 27373 tablet_bootstrap.cc:654] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:50.984295 27373 log.cc:824] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:50.984628 27375 tablet_bootstrap.cc:654] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:50.985008 27374 tablet_bootstrap.cc:492] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7: Bootstrap starting.
I20260808 08:29:50.985597 27375 log.cc:824] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:50.986649 27373 tablet_bootstrap.cc:492] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198: No bootstrap required, opened a new log
I20260808 08:29:50.986864 27373 ts_tablet_manager.cc:1397] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:29:50.987516 27375 tablet_bootstrap.cc:492] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad: No bootstrap required, opened a new log
I20260808 08:29:50.987715 27375 ts_tablet_manager.cc:1397] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:29:50.987838 27374 tablet_bootstrap.cc:654] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:50.988731 27374 log.cc:824] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:50.990818 27374 tablet_bootstrap.cc:492] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7: No bootstrap required, opened a new log
I20260808 08:29:50.990993 27374 ts_tablet_manager.cc:1397] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260808 08:29:50.991183 27373 raft_consensus.cc:348] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02665c6b8b344579e216f35905d07a7" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36433 } } peers { permanent_uuid: "782fc87af97747c68ca4e7813f6f1198" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45975 } } peers { permanent_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46769 } }
I20260808 08:29:50.991475 27373 raft_consensus.cc:374] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:50.991535 27373 raft_consensus.cc:729] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 782fc87af97747c68ca4e7813f6f1198, State: Initialized, Role: FOLLOWER
I20260808 08:29:50.991940 27375 raft_consensus.cc:348] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02665c6b8b344579e216f35905d07a7" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36433 } } peers { permanent_uuid: "782fc87af97747c68ca4e7813f6f1198" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45975 } } peers { permanent_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46769 } }
I20260808 08:29:50.992033 27373 consensus_queue.cc:260] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02665c6b8b344579e216f35905d07a7" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36433 } } peers { permanent_uuid: "782fc87af97747c68ca4e7813f6f1198" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45975 } } peers { permanent_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46769 } }
I20260808 08:29:50.992172 27375 raft_consensus.cc:374] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:50.992225 27375 raft_consensus.cc:729] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5fdb8cdafac46f79c5d063a2d0263ad, State: Initialized, Role: FOLLOWER
I20260808 08:29:50.992671 27375 consensus_queue.cc:260] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02665c6b8b344579e216f35905d07a7" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36433 } } peers { permanent_uuid: "782fc87af97747c68ca4e7813f6f1198" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45975 } } peers { permanent_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46769 } }
I20260808 08:29:50.992744 27355 heartbeater.cc:503] Master 127.25.170.62:35619 was elected leader, sending a full tablet report...
I20260808 08:29:50.993103 27373 ts_tablet_manager.cc:1428] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:29:50.993618 27375 ts_tablet_manager.cc:1428] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260808 08:29:50.993965 27076 heartbeater.cc:503] Master 127.25.170.62:35619 was elected leader, sending a full tablet report...
I20260808 08:29:50.994980 27374 raft_consensus.cc:348] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02665c6b8b344579e216f35905d07a7" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36433 } } peers { permanent_uuid: "782fc87af97747c68ca4e7813f6f1198" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45975 } } peers { permanent_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46769 } }
I20260808 08:29:50.995286 27374 raft_consensus.cc:374] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:50.995338 27374 raft_consensus.cc:729] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02665c6b8b344579e216f35905d07a7, State: Initialized, Role: FOLLOWER
I20260808 08:29:50.995800 27374 consensus_queue.cc:260] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02665c6b8b344579e216f35905d07a7" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36433 } } peers { permanent_uuid: "782fc87af97747c68ca4e7813f6f1198" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45975 } } peers { permanent_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46769 } }
I20260808 08:29:50.996822 27374 ts_tablet_manager.cc:1428] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260808 08:29:50.997156 27217 heartbeater.cc:503] Master 127.25.170.62:35619 was elected leader, sending a full tablet report...
I20260808 08:29:51.123334 27382 raft_consensus.cc:482] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:29:51.123570 27382 raft_consensus.cc:504] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02665c6b8b344579e216f35905d07a7" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36433 } } peers { permanent_uuid: "782fc87af97747c68ca4e7813f6f1198" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45975 } } peers { permanent_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46769 } }
I20260808 08:29:51.124902 27382 leader_election.cc:288] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 782fc87af97747c68ca4e7813f6f1198 (127.25.170.3:45975), d5fdb8cdafac46f79c5d063a2d0263ad (127.25.170.1:46769)
I20260808 08:29:51.129205 27219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:51.125204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:45975 (local address 127.25.170.2:53869)
0808 08:29:51.125468 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:51.125486 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:51.125590 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:51.125893 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:51.125896 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:51.125916 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:51.126066 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:51.126077 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.126981 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.126984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:51.127877 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:51.127942 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.128720 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.128723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:51.128868 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:51.128911 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 08:29:51.128985 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 08:29:51.129075 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160}
I20260808 08:29:51.129423 27383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:51.125476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:46769 (local address 127.25.170.2:33369)
0808 08:29:51.125907 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:51.125920 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:51.126044 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:51.126315 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:51.126318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:51.126337 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:51.126490 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:51.126497 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.127276 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.127278 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:51.128241 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:51.128253 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.128986 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.128990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:51.129100 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:51.129123 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:29:51.129202 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 08:29:51.129263 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":143,"threads_started":1}
I20260808 08:29:51.129278 27371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:51.125405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:53869 (local address 127.25.170.3:45975)
0808 08:29:51.125552 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:51.125556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:51.125571 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:29:51.125721 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:51.125726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:51.125783 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:51.125867 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:51.126202 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.126872 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.128073 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.128597 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.128692 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:51.128735 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:51.129018 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 08:29:51.129098 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:29:51.129698 27372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:51.125623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:33369 (local address 127.25.170.1:46769)
0808 08:29:51.125761 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:51.125771 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:51.126035 (+ 264us) server_negotiation.cc:407] Connection header received
0808 08:29:51.126147 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:51.126153 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:51.126215 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:51.126274 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:51.126616 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.127158 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.128366 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.128842 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.128973 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:51.129023 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:51.129238 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 08:29:51.129331 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:29:51.130072 27307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a36e86ee751451aa6227404af76536c" candidate_uuid: "b02665c6b8b344579e216f35905d07a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782fc87af97747c68ca4e7813f6f1198" is_pre_election: true
I20260808 08:29:51.130393 27307 raft_consensus.cc:2454] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02665c6b8b344579e216f35905d07a7 in term 0.
I20260808 08:29:51.130393 27028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a36e86ee751451aa6227404af76536c" candidate_uuid: "b02665c6b8b344579e216f35905d07a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" is_pre_election: true
I20260808 08:29:51.130676 27028 raft_consensus.cc:2454] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02665c6b8b344579e216f35905d07a7 in term 0.
I20260808 08:29:51.130949 27102 leader_election.cc:302] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 782fc87af97747c68ca4e7813f6f1198, b02665c6b8b344579e216f35905d07a7; no voters:
I20260808 08:29:51.131260 27382 raft_consensus.cc:2781] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:29:51.131353 27382 raft_consensus.cc:482] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:29:51.131398 27382 raft_consensus.cc:3037] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:51.132616 27382 raft_consensus.cc:504] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02665c6b8b344579e216f35905d07a7" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36433 } } peers { permanent_uuid: "782fc87af97747c68ca4e7813f6f1198" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45975 } } peers { permanent_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46769 } }
I20260808 08:29:51.132965 27382 leader_election.cc:288] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [CANDIDATE]: Term 1 election: Requested vote from peers 782fc87af97747c68ca4e7813f6f1198 (127.25.170.3:45975), d5fdb8cdafac46f79c5d063a2d0263ad (127.25.170.1:46769)
I20260808 08:29:51.133289 27307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a36e86ee751451aa6227404af76536c" candidate_uuid: "b02665c6b8b344579e216f35905d07a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "782fc87af97747c68ca4e7813f6f1198"
I20260808 08:29:51.133392 27028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a36e86ee751451aa6227404af76536c" candidate_uuid: "b02665c6b8b344579e216f35905d07a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad"
I20260808 08:29:51.133409 27307 raft_consensus.cc:3037] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:51.133546 27028 raft_consensus.cc:3037] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:51.134614 27307 raft_consensus.cc:2454] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02665c6b8b344579e216f35905d07a7 in term 1.
I20260808 08:29:51.134639 27028 raft_consensus.cc:2454] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02665c6b8b344579e216f35905d07a7 in term 1.
I20260808 08:29:51.134950 27102 leader_election.cc:302] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 782fc87af97747c68ca4e7813f6f1198, b02665c6b8b344579e216f35905d07a7; no voters:
I20260808 08:29:51.135129 27382 raft_consensus.cc:2781] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:51.135351 27382 raft_consensus.cc:686] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [term 1 LEADER]: Becoming Leader. State: Replica: b02665c6b8b344579e216f35905d07a7, State: Running, Role: LEADER
I20260808 08:29:51.135699 27382 consensus_queue.cc:237] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02665c6b8b344579e216f35905d07a7" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36433 } } peers { permanent_uuid: "782fc87af97747c68ca4e7813f6f1198" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45975 } } peers { permanent_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46769 } }
I20260808 08:29:51.139266 26877 catalog_manager.cc:5495] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b02665c6b8b344579e216f35905d07a7 (127.25.170.2). New cstate: current_term: 1 leader_uuid: "b02665c6b8b344579e216f35905d07a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02665c6b8b344579e216f35905d07a7" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "782fc87af97747c68ca4e7813f6f1198" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5fdb8cdafac46f79c5d063a2d0263ad" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46769 } health_report { overall_health: UNKNOWN } } }
W20260808 08:29:51.158725 27356 tablet.cc:2369] T 4a36e86ee751451aa6227404af76536c P 782fc87af97747c68ca4e7813f6f1198: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 08:29:51 dist-test-slave-zkpd krb5kdc[26831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:29:51.165138 27372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:51.155587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44072 (local address 127.25.170.1:46769)
0808 08:29:51.155760 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:51.155765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:51.155958 (+ 193us) server_negotiation.cc:407] Connection header received
0808 08:29:51.156139 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:51.156147 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:51.156190 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:51.156279 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:51.156985 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.157486 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.158489 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.158734 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.158872 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:51.161580 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:51.161602 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:51.161615 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:51.161639 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:51.163319 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:51.163777 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:51.163783 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:51.163784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:51.163872 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:51.164182 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:51.164186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:51.164188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:51.164446 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:51.164654 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:51.164836 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 08:29:51.164966 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
Aug 08 08:29:51 dist-test-slave-zkpd krb5kdc[26831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177791, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:29:51 dist-test-slave-zkpd krb5kdc[26831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177791, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
W20260808 08:29:51.192615 27218 tablet.cc:2369] T 4a36e86ee751451aa6227404af76536c P b02665c6b8b344579e216f35905d07a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:29:51.193197 27372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:51.184723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44074 (local address 127.25.170.1:46769)
0808 08:29:51.184864 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:51.184870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:51.185029 (+ 159us) server_negotiation.cc:407] Connection header received
0808 08:29:51.185204 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:51.185207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:51.185249 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:51.185335 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:51.186124 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.186722 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.187558 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.187790 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.187936 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:51.190195 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:51.190198 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:51.190200 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:51.190222 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:51.191429 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:51.191859 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:51.191864 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:51.191866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:51.192002 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:51.192280 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:51.192284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:51.192285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:51.192452 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:51.192588 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:51.192913 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 08:29:51.193049 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 08:29:51 dist-test-slave-zkpd krb5kdc[26831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 08:29:51.205377 27077 tablet.cc:2369] T 4a36e86ee751451aa6227404af76536c P d5fdb8cdafac46f79c5d063a2d0263ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
Password for test-admin@KRBTEST.COM:
Aug 08 08:29:51 dist-test-slave-zkpd krb5kdc[26831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:29:51.219008 27372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:51.210921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44076 (local address 127.25.170.1:46769)
0808 08:29:51.211061 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:51.211066 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:51.211237 (+ 171us) server_negotiation.cc:407] Connection header received
0808 08:29:51.211417 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:51.211424 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:51.211467 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:51.211558 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:51.212313 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.212808 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.213682 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:51.213911 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:51.214022 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:51.216360 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:51.216362 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:51.216364 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:51.216386 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:51.217617 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:51.217984 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:51.217987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:51.217988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:51.218108 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:51.218357 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:51.218359 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:51.218360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:51.218512 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:51.218610 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:51.218805 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 08:29:51.218893 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 08:29:51.220407 26988 tablet_service.cc:2908] Rejecting scan request for tablet 4a36e86ee751451aa6227404af76536c: Uninitialized: clean time has not yet been initialized
I20260808 08:29:51.222412 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 26943
I20260808 08:29:51.231171 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 27082
I20260808 08:29:51.238206 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 27223
I20260808 08:29:51.244622 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 26845
2026-08-08T08:29:51Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2461 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:29:51 dist-test-slave-zkpd krb5kdc[27401](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:29:51 dist-test-slave-zkpd krb5kdc[27401](info): set up 2 sockets
Aug 08 08:29:51 dist-test-slave-zkpd krb5kdc[27401](info): commencing operation
krb5kdc: starting...
W20260808 08:29:52.313660 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:29:52 dist-test-slave-zkpd krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:29:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:29:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:29:52.436275 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:42789
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:34079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:42789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:52.544725 27414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:52.545018 27414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:52.545100 27414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:52.549129 27414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:29:52.549202 27414 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:29:52.549234 27414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:52.549291 27414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:52.549353 27414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:29:52.549393 27414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:29:52.554315 27414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:34079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:42789
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:42789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:52.555265 27414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:52.556295 27414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:52.564702 27423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:52.564778 27419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:52.564791 27414 server_base.cc:1034] running on GCE node
W20260808 08:29:52.564986 27420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:52.565474 27414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:52.566427 27414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:52.567588 27414 hybrid_clock.cc:648] HybridClock initialized: now 1786177792567561 us; error 38 us; skew 500 ppm
Aug 08 08:29:52 dist-test-slave-zkpd krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177792, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:52.575155 27414 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:29:52.576099 27414 webserver.cc:460] Webserver started at http://127.25.170.62:33037/ using document root <none> and password file <none>
I20260808 08:29:52.576642 27414 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:52.576732 27414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:52.576961 27414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:52.578971 27414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "8a344d61a7844d86bbbcff5d6ac32fbe"
format_stamp: "Formatted at 2026-08-08 08:29:52 on dist-test-slave-zkpd"
server_key: "54e8709785ec43a4997f0d3a3920e33d"
server_key_iv: "d4351430aa984aa1c47bec2f84d3bd83"
server_key_version: "encryptionkey@0"
I20260808 08:29:52.579543 27414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "8a344d61a7844d86bbbcff5d6ac32fbe"
format_stamp: "Formatted at 2026-08-08 08:29:52 on dist-test-slave-zkpd"
server_key: "54e8709785ec43a4997f0d3a3920e33d"
server_key_iv: "d4351430aa984aa1c47bec2f84d3bd83"
server_key_version: "encryptionkey@0"
I20260808 08:29:52.583176 27414 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.002s
I20260808 08:29:52.585536 27431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:52.586668 27414 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:29:52.586810 27414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "8a344d61a7844d86bbbcff5d6ac32fbe"
format_stamp: "Formatted at 2026-08-08 08:29:52 on dist-test-slave-zkpd"
server_key: "54e8709785ec43a4997f0d3a3920e33d"
server_key_iv: "d4351430aa984aa1c47bec2f84d3bd83"
server_key_version: "encryptionkey@0"
I20260808 08:29:52.586916 27414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:52.620904 27414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:52.623863 27414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:52.624090 27414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:52.631981 27414 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:42789
I20260808 08:29:52.632001 27500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:42789 every 8 connection(s)
I20260808 08:29:52.633028 27414 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:29:52.635691 27502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:52.641047 27502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe: Bootstrap starting.
I20260808 08:29:52.642449 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 27414
I20260808 08:29:52.642541 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:29:52.642792 26280 external_mini_cluster.cc:1428] Setting key 7ec25abdafc6698eb3552710130ac917
I20260808 08:29:52.643482 27502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:52.644375 27502 log.cc:824] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:52.646456 27502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe: No bootstrap required, opened a new log
I20260808 08:29:52.650687 27502 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a344d61a7844d86bbbcff5d6ac32fbe" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42789 } }
I20260808 08:29:52.650995 27502 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:52.651067 27502 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a344d61a7844d86bbbcff5d6ac32fbe, State: Initialized, Role: FOLLOWER
Aug 08 08:29:52 dist-test-slave-zkpd krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:52.651566 27502 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a344d61a7844d86bbbcff5d6ac32fbe" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42789 } }
I20260808 08:29:52.651748 27502 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:29:52.651876 27502 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:29:52.652025 27502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:52.653061 27502 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a344d61a7844d86bbbcff5d6ac32fbe" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42789 } }
I20260808 08:29:52.653467 27502 leader_election.cc:302] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a344d61a7844d86bbbcff5d6ac32fbe; no voters:
I20260808 08:29:52.653851 27502 leader_election.cc:288] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:29:52.653923 27507 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:52.654117 27507 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [term 1 LEADER]: Becoming Leader. State: Replica: 8a344d61a7844d86bbbcff5d6ac32fbe, State: Running, Role: LEADER
I20260808 08:29:52.654466 27507 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a344d61a7844d86bbbcff5d6ac32fbe" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42789 } }
I20260808 08:29:52.655112 27502 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:29:52.656150 27508 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a344d61a7844d86bbbcff5d6ac32fbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a344d61a7844d86bbbcff5d6ac32fbe" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42789 } } }
I20260808 08:29:52.656296 27508 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [sys.catalog]: This master's current role is: LEADER
I20260808 08:29:52.656590 27509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a344d61a7844d86bbbcff5d6ac32fbe. Latest consensus state: current_term: 1 leader_uuid: "8a344d61a7844d86bbbcff5d6ac32fbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a344d61a7844d86bbbcff5d6ac32fbe" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42789 } } }
I20260808 08:29:52.656761 27509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe [sys.catalog]: This master's current role is: LEADER
I20260808 08:29:52.658394 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:52.643843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58900 (local address 127.25.170.62:42789)
0808 08:29:52.644317 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:52.644333 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:52.644368 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:29:52.644991 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:52.645006 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:52.645296 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:52.645566 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:52.646444 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:52.647503 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:52.648799 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:52.649260 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:52.649394 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:52.652533 (+ 3139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:52.652538 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:52.652551 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:52.652576 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:52.654626 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:52.655144 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:52.655150 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:52.655155 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:52.655328 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:52.655652 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:52.655656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:52.655657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:52.656193 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:52.656390 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:52.657235 (+ 845us) server_negotiation.cc:299] Negotiation successful
0808 08:29:52.657555 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":124,"threads_started":1}
W20260808 08:29:52.660480 27524 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:29:52.660553 27524 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:29:52.660632 27516 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:29:52.661271 27516 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:29:52.666208 27516 catalog_manager.cc:1347] Generated new cluster ID: 12669f7540ba4447ad129a6851b38ca9
I20260808 08:29:52.666270 27516 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:29:52.692904 27516 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:29:52.694214 27516 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:29:52.705904 27516 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe: Generated new TSK 0
I20260808 08:29:52.706667 27516 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:29:52.742369 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:42789
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:34079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:52.856117 27529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:52.856387 27529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:52.856473 27529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:52.860618 27529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:52.860671 27529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:52.860708 27529 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:29:52.860740 27529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:29:52.865782 27529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:34079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.170.62:42789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:52.866683 27529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:52.867610 27529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:52.876852 27538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:52.876866 27534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:52.876885 27535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:52.877168 27529 server_base.cc:1034] running on GCE node
I20260808 08:29:52.877604 27529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:52.878254 27529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:52.879448 27529 hybrid_clock.cc:648] HybridClock initialized: now 1786177792879433 us; error 25 us; skew 500 ppm
Aug 08 08:29:52 dist-test-slave-zkpd krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177792, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:52.882150 27529 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:29:52.883167 27529 webserver.cc:460] Webserver started at http://127.25.170.1:38159/ using document root <none> and password file <none>
I20260808 08:29:52.883836 27529 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:52.883967 27529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:52.884189 27529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:52.887204 27529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "150bc2bd82cd4865be67a088e46684f9"
format_stamp: "Formatted at 2026-08-08 08:29:52 on dist-test-slave-zkpd"
server_key: "d6bb07cb490ad024014969af2e32da8c"
server_key_iv: "694d362a7f57ff0b6becc49f90b21e84"
server_key_version: "encryptionkey@0"
I20260808 08:29:52.888010 27529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "150bc2bd82cd4865be67a088e46684f9"
format_stamp: "Formatted at 2026-08-08 08:29:52 on dist-test-slave-zkpd"
server_key: "d6bb07cb490ad024014969af2e32da8c"
server_key_iv: "694d362a7f57ff0b6becc49f90b21e84"
server_key_version: "encryptionkey@0"
I20260808 08:29:52.893193 27529 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:29:52.895509 27546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:52.896790 27529 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:29:52.896885 27529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "150bc2bd82cd4865be67a088e46684f9"
format_stamp: "Formatted at 2026-08-08 08:29:52 on dist-test-slave-zkpd"
server_key: "d6bb07cb490ad024014969af2e32da8c"
server_key_iv: "694d362a7f57ff0b6becc49f90b21e84"
server_key_version: "encryptionkey@0"
I20260808 08:29:52.896965 27529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:52.921744 27529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:52.924708 27529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:52.924856 27529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:52.926183 27529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:52.926239 27529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:52.926313 27529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:52.926357 27529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:29:52 dist-test-slave-zkpd krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177792, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:52.937785 27529 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:45369
I20260808 08:29:52.937881 27665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:45369 every 8 connection(s)
I20260808 08:29:52.938856 27529 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:29:52.940523 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:52.927084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:43271 (local address 127.25.170.62:42789)
0808 08:29:52.927209 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:52.927213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:52.928297 (+ 1084us) server_negotiation.cc:407] Connection header received
0808 08:29:52.929362 (+ 1065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:52.929366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:52.929433 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:52.929499 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:52.930929 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:52.931861 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:52.933101 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:52.933351 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:52.933476 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:52.936603 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:52.936607 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:52.936610 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:52.936642 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:52.938313 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:52.938788 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:52.938792 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:52.938794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:52.938902 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:52.939326 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:52.939330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:52.939332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:52.939553 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:52.939660 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:52.940303 (+ 643us) server_negotiation.cc:299] Negotiation successful
0808 08:29:52.940406 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 08:29:52.941371 27555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:52.927619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:42789 (local address 127.25.170.1:43271)
0808 08:29:52.928146 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:52.928195 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:52.929093 (+ 898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:52.929838 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:52.929844 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:52.930222 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:52.930671 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:52.930684 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:52.932016 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:52.932022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:52.932961 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:52.932971 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:52.933663 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:52.933666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:52.933916 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:52.934536 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:52.934554 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:52.936411 (+ 1857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:52.938423 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:52.938427 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:52.938437 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:52.938678 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:52.939025 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:52.939028 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:52.939030 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:52.939205 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:52.939714 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:52.939720 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:52.940046 (+ 326us) client_negotiation.cc:769] Sending connection context
0808 08:29:52.940271 (+ 225us) client_negotiation.cc:240] Negotiation successful
0808 08:29:52.940522 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":169,"threads_started":1}
I20260808 08:29:52.941416 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 27529
I20260808 08:29:52.941519 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:29:52.941841 26280 external_mini_cluster.cc:1428] Setting key fc912de16320fa0e2b6343850418f0a6
I20260808 08:29:52.943238 27666 heartbeater.cc:347] Connected to a master server at 127.25.170.62:42789
I20260808 08:29:52.943401 27666 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:52.943873 27666 heartbeater.cc:511] Master 127.25.170.62:42789 requested a full tablet report, sending...
I20260808 08:29:52.945281 27448 ts_manager.cc:194] Registered new tserver with Master: 150bc2bd82cd4865be67a088e46684f9 (127.25.170.1:45369)
I20260808 08:29:52.946415 27448 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:43271
I20260808 08:29:52.954807 27672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:52.945372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:42789 (local address 127.25.170.1:56057)
0808 08:29:52.947500 (+ 2128us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:52.947520 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:52.947626 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:52.947920 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:52.947926 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:52.948156 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:52.948303 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:52.948313 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:52.949286 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:52.949289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:52.949838 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:52.949846 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:52.950496 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:52.950499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:52.950568 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:52.951073 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:52.951085 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:52.951389 (+ 304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:52.953327 (+ 1938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:52.953329 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:52.953331 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:52.953511 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:52.953837 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:52.953839 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:52.953841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:52.953915 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:52.954347 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:52.954349 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:52.954421 (+ 72us) client_negotiation.cc:769] Sending connection context
0808 08:29:52.954501 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 08:29:52.954646 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2023,"thread_start_us":91,"threads_started":1}
I20260808 08:29:52.954954 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:52.946925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:56057 (local address 127.25.170.62:42789)
0808 08:29:52.947049 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:52.947053 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:52.947608 (+ 555us) server_negotiation.cc:407] Connection header received
0808 08:29:52.947717 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:52.947720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:52.947765 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:52.947865 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:52.948439 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:52.949148 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:52.949963 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:52.950379 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:52.950509 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:52.951538 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:52.951543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:52.951548 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:52.951581 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:52.953219 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:52.953614 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:52.953620 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:52.953622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:52.953726 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:52.954014 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:52.954017 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:52.954019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:52.954247 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:52.954368 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:52.954637 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 08:29:52.954773 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:29:52.973130 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:42789
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:34079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:53.083628 27675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:53.083879 27675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:53.083969 27675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:53.087806 27675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:53.087886 27675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:53.087973 27675 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:29:53.088052 27675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:29:53.093277 27675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:34079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.170.62:42789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:53.094238 27675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:53.095235 27675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:29:53.104818 27675 server_base.cc:1034] running on GCE node
W20260808 08:29:53.104802 27681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:53.104771 27682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:53.104768 27684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:53.105448 27675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:53.106003 27675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:53.107161 27675 hybrid_clock.cc:648] HybridClock initialized: now 1786177793107150 us; error 24 us; skew 500 ppm
Aug 08 08:29:53 dist-test-slave-zkpd krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177793, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:53.109843 27675 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:29:53.110638 27675 webserver.cc:460] Webserver started at http://127.25.170.2:37293/ using document root <none> and password file <none>
I20260808 08:29:53.111135 27675 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:53.111191 27675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:53.111340 27675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:53.113307 27675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "6beddcd53e464c27a745fe600324286f"
format_stamp: "Formatted at 2026-08-08 08:29:53 on dist-test-slave-zkpd"
server_key: "a495f8a81fbf94c775dfa0422a096fb7"
server_key_iv: "05bc7274c81e4601158815c001037b49"
server_key_version: "encryptionkey@0"
I20260808 08:29:53.113847 27675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "6beddcd53e464c27a745fe600324286f"
format_stamp: "Formatted at 2026-08-08 08:29:53 on dist-test-slave-zkpd"
server_key: "a495f8a81fbf94c775dfa0422a096fb7"
server_key_iv: "05bc7274c81e4601158815c001037b49"
server_key_version: "encryptionkey@0"
I20260808 08:29:53.117321 27675 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:29:53.119500 27691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:53.120812 27675 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:29:53.120958 27675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "6beddcd53e464c27a745fe600324286f"
format_stamp: "Formatted at 2026-08-08 08:29:53 on dist-test-slave-zkpd"
server_key: "a495f8a81fbf94c775dfa0422a096fb7"
server_key_iv: "05bc7274c81e4601158815c001037b49"
server_key_version: "encryptionkey@0"
I20260808 08:29:53.121068 27675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:53.147598 27675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:53.150523 27675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:53.150733 27675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:53.152381 27675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:53.152452 27675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:53.152525 27675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:53.152568 27675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:29:53 dist-test-slave-zkpd krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177793, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:53.164989 27675 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:40997
I20260808 08:29:53.165875 27675 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:29:53.166707 27811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:40997 every 8 connection(s)
I20260808 08:29:53.168256 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.153244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:56983 (local address 127.25.170.62:42789)
0808 08:29:53.153427 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.153434 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.154346 (+ 912us) server_negotiation.cc:407] Connection header received
0808 08:29:53.155727 (+ 1381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.155734 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.155805 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.155872 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:53.158245 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.158890 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.160841 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.161136 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.161276 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.164308 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:53.164311 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:53.164313 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:53.164338 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:53.165983 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:53.166616 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:53.166621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:53.166622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:53.166727 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:53.167221 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:53.167224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:53.167225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:53.167415 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:53.167494 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.168027 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.168138 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:29:53.169081 27700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.153625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:42789 (local address 127.25.170.2:56983)
0808 08:29:53.154156 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:53.154219 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:53.155400 (+ 1181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:53.156779 (+ 1379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:53.156787 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:53.157274 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:53.158062 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.158086 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.159073 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.159077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.160678 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.160695 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.161333 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.161338 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.161594 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.162263 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:53.162280 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:53.164121 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:53.166087 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:53.166093 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:53.166107 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:53.166479 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:53.166987 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:53.166989 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:53.166990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:53.167119 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:53.167508 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:53.167513 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:53.167729 (+ 216us) client_negotiation.cc:769] Sending connection context
0808 08:29:53.167958 (+ 229us) client_negotiation.cc:240] Negotiation successful
0808 08:29:53.168226 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":119,"threads_started":1}
I20260808 08:29:53.169271 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 27675
I20260808 08:29:53.169391 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:29:53.169682 26280 external_mini_cluster.cc:1428] Setting key 8ebfd2823595beed5ff58a680023459d
I20260808 08:29:53.170771 27812 heartbeater.cc:347] Connected to a master server at 127.25.170.62:42789
I20260808 08:29:53.170948 27812 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:53.171473 27812 heartbeater.cc:511] Master 127.25.170.62:42789 requested a full tablet report, sending...
I20260808 08:29:53.172538 27446 ts_manager.cc:194] Registered new tserver with Master: 6beddcd53e464c27a745fe600324286f (127.25.170.2:40997)
I20260808 08:29:53.173228 27446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:56983
I20260808 08:29:53.181129 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.173043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:42789 (local address 127.25.170.2:41143)
0808 08:29:53.173345 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:53.173363 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:53.173464 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:53.174024 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:53.174028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:53.174290 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:53.174449 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.174459 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.175437 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.175439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.176105 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.176115 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.176733 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.176735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.176821 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.177336 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:53.177348 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:53.177641 (+ 293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:53.179600 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:53.179602 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:53.179603 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:53.179790 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:53.180145 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:53.180147 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:53.180149 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:53.180228 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:53.180742 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:53.180744 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:53.180824 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 08:29:53.180902 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 08:29:53.181003 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":93,"threads_started":1}
I20260808 08:29:53.181303 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.173617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:41143 (local address 127.25.170.62:42789)
0808 08:29:53.173781 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.173785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.173798 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:29:53.173830 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.173833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.173900 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.173985 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:53.174591 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.175311 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.176220 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.176614 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.176741 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.177792 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:53.177799 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:53.177805 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:53.177838 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:53.179479 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:53.179932 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:53.179936 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:53.179938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:53.180037 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:53.180329 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:53.180334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:53.180336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:53.180634 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:53.180747 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.180992 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.181118 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:29:53.200199 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:42789
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:34079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:53.316123 27821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:53.316365 27821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:53.316409 27821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:53.320456 27821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:53.320510 27821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:53.320549 27821 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:29:53.320613 27821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:29:53.325913 27821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:34079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.170.62:42789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:53.326969 27821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:53.328009 27821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:53.337453 27828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:53.337661 27830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:53.337838 27827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:53.337994 27821 server_base.cc:1034] running on GCE node
I20260808 08:29:53.338413 27821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:53.339020 27821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:53.340204 27821 hybrid_clock.cc:648] HybridClock initialized: now 1786177793340184 us; error 32 us; skew 500 ppm
Aug 08 08:29:53 dist-test-slave-zkpd krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177793, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:53.343027 27821 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:29:53.343799 27821 webserver.cc:460] Webserver started at http://127.25.170.3:40443/ using document root <none> and password file <none>
I20260808 08:29:53.344446 27821 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:53.344538 27821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:53.344761 27821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:53.346751 27821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "fb6e86c5ab494b09b9e400ea3c77363a"
format_stamp: "Formatted at 2026-08-08 08:29:53 on dist-test-slave-zkpd"
server_key: "53c2e72dde7ab1a47a705444532b3b3a"
server_key_iv: "749b236d3bfa3caed9efb8203cd7bed9"
server_key_version: "encryptionkey@0"
I20260808 08:29:53.347332 27821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "fb6e86c5ab494b09b9e400ea3c77363a"
format_stamp: "Formatted at 2026-08-08 08:29:53 on dist-test-slave-zkpd"
server_key: "53c2e72dde7ab1a47a705444532b3b3a"
server_key_iv: "749b236d3bfa3caed9efb8203cd7bed9"
server_key_version: "encryptionkey@0"
I20260808 08:29:53.351011 27821 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:29:53.353464 27837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:53.354760 27821 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:29:53.354904 27821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "fb6e86c5ab494b09b9e400ea3c77363a"
format_stamp: "Formatted at 2026-08-08 08:29:53 on dist-test-slave-zkpd"
server_key: "53c2e72dde7ab1a47a705444532b3b3a"
server_key_iv: "749b236d3bfa3caed9efb8203cd7bed9"
server_key_version: "encryptionkey@0"
I20260808 08:29:53.355013 27821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:53.387845 27821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:53.391562 27821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:53.391772 27821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:53.393342 27821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:53.393416 27821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:53.393493 27821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:53.393543 27821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:29:53 dist-test-slave-zkpd krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177793, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:53.405481 27821 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:37691
I20260808 08:29:53.405560 27955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:37691 every 8 connection(s)
I20260808 08:29:53.406672 27821 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:29:53.407474 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 27821
I20260808 08:29:53.407640 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:29:53.407985 26280 external_mini_cluster.cc:1428] Setting key 79e8cd07f4509b8e505a7e6e79011110
I20260808 08:29:53.410212 27846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.395053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:42789 (local address 127.25.170.3:40711)
0808 08:29:53.395601 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:53.395646 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:53.396673 (+ 1027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:53.397352 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:53.397365 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:53.397839 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:53.398591 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.398616 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.399832 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.399836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.401051 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.401062 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.401755 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.401762 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.401943 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.402629 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:53.402649 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:53.404602 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:53.406692 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:53.406705 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:53.406716 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:53.407097 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:53.407526 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:53.407533 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:53.407535 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:53.407930 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:53.408503 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:53.408508 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:53.408815 (+ 307us) client_negotiation.cc:769] Sending connection context
0808 08:29:53.409020 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 08:29:53.409285 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":156,"threads_started":1}
I20260808 08:29:53.410830 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.394489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:40711 (local address 127.25.170.62:42789)
0808 08:29:53.394618 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.394622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.395763 (+ 1141us) server_negotiation.cc:407] Connection header received
0808 08:29:53.396956 (+ 1193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.396959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.397019 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.397116 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:53.398773 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.399631 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.401158 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.401572 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.401702 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.404783 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:53.404790 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:53.404793 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:53.404821 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:53.406555 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:53.407256 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:53.407260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:53.407261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:53.407376 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:53.408092 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:53.408095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:53.408097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:53.408340 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:53.408441 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.410624 (+ 2183us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.410721 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:29:53.411700 27956 heartbeater.cc:347] Connected to a master server at 127.25.170.62:42789
I20260808 08:29:53.411852 27956 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:53.412436 27956 heartbeater.cc:511] Master 127.25.170.62:42789 requested a full tablet report, sending...
I20260808 08:29:53.413434 27448 ts_manager.cc:194] Registered new tserver with Master: fb6e86c5ab494b09b9e400ea3c77363a (127.25.170.3:37691)
I20260808 08:29:53.414029 27448 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:40711
I20260808 08:29:53.420876 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.414098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:60197 (local address 127.25.170.62:42789)
0808 08:29:53.414201 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.414205 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.414420 (+ 215us) server_negotiation.cc:407] Connection header received
0808 08:29:53.414503 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.414506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.414550 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.414636 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:53.415148 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.415625 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.416560 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.416758 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.416887 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.417888 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:53.417894 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:53.417900 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:53.417921 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:53.419249 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:53.419679 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:53.419683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:53.419685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:53.419764 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:53.420096 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:53.420100 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:53.420102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:53.420266 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:53.420375 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.420631 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.420737 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:29:53.420894 27962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.414039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:42789 (local address 127.25.170.3:60197)
0808 08:29:53.414331 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:53.414343 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:53.414427 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:53.414669 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:53.414672 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:53.414895 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:53.415025 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.415033 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.415762 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.415765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.416457 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.416467 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.416893 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.416897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.417012 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.417422 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:53.417433 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:53.417718 (+ 285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:53.419374 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:53.419378 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:53.419380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:53.419578 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:53.419871 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:53.419874 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:53.419876 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:53.419996 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:53.420367 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:53.420370 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:53.420469 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 08:29:53.420576 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 08:29:53.420712 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":8,"thread_start_us":123,"threads_started":1}
I20260808 08:29:53.422108 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:29:53 dist-test-slave-zkpd krb5kdc[27401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177793, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:29:53 dist-test-slave-zkpd krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177793, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:53.448549 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.440537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58914 (local address 127.25.170.62:42789)
0808 08:29:53.440665 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.440669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.440680 (+ 11us) server_negotiation.cc:407] Connection header received
0808 08:29:53.440716 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.440718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.440754 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.440849 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:53.441520 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.442024 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.442860 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.443077 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.443207 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.445557 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:53.445560 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:53.445562 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:53.445587 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:53.446880 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:53.447294 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:53.447302 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:53.447309 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:53.447401 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:53.447675 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:53.447679 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:53.447680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:53.447859 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:53.448023 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.448263 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.448390 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:29:53.451318 27446 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58914:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:29:53.454329 27446 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:29:53.470497 27975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.463676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45369 (local address 127.0.0.1:38390)
0808 08:29:53.464476 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:53.464525 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:53.464655 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:53.465453 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:53.465459 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:53.465484 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:53.465621 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.465628 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.466912 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.466918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.468933 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.468939 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.469951 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.469955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.470063 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.470104 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 08:29:53.470219 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:29:53.470336 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":211,"thread_start_us":71,"threads_started":1}
I20260808 08:29:53.470511 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.464301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38390 (local address 127.25.170.1:45369)
0808 08:29:53.464577 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.464584 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.464610 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:29:53.464861 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.464867 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.465095 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.465262 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:53.465778 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.466807 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.469033 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.469819 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.469940 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.470133 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.470264 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.470376 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":79,"threads_started":1}
I20260808 08:29:53.471148 27979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.465121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:37691 (local address 127.0.0.1:47804)
0808 08:29:53.466154 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:53.466167 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:53.466249 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:53.466938 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:53.466941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:53.466959 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:53.467039 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.467045 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.468476 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.468479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.469510 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.469520 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.470763 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.470767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.470863 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.470886 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:29:53.470967 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 08:29:53.471033 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":978,"mutex_wait_us":1,"thread_start_us":344,"threads_started":1}
I20260808 08:29:53.471194 27977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.464645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41638 (local address 127.25.170.2:40997)
0808 08:29:53.465978 (+ 1333us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.465992 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.466017 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:29:53.466096 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.466101 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.466288 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.466444 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:53.466667 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.467598 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.468950 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.469820 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.469940 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.470853 (+ 913us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.470914 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.471026 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1228,"thread_start_us":141,"threads_started":1}
I20260808 08:29:53.470527 27980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.463923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:40997 (local address 127.0.0.1:41638)
0808 08:29:53.465798 (+ 1875us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:53.465811 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:53.465894 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:53.466442 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:53.466445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:53.466465 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:53.466548 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.466553 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.467710 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.467715 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.468793 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.468804 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.470120 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.470124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.470255 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.470281 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:29:53.470346 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 08:29:53.470408 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1815,"mutex_wait_us":28,"thread_start_us":1362,"threads_started":1}
I20260808 08:29:53.471508 27978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.465051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47804 (local address 127.25.170.3:37691)
0808 08:29:53.465666 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.465680 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.466360 (+ 680us) server_negotiation.cc:407] Connection header received
0808 08:29:53.466443 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.466448 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.466646 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.466793 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:53.467165 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.468345 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.469632 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.470409 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.470513 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.470695 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.471012 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.471104 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":113,"threads_started":1}
I20260808 08:29:53.473915 27598 tablet_service.cc:1467] Processing CreateTablet for tablet 4b43acb5622b42fca8211fdb491b5625 (DEFAULT_TABLE table=test-table [id=2197fda5f63943cfb2772b046bce6ac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:53.474370 27744 tablet_service.cc:1467] Processing CreateTablet for tablet 4b43acb5622b42fca8211fdb491b5625 (DEFAULT_TABLE table=test-table [id=2197fda5f63943cfb2772b046bce6ac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:53.474463 27889 tablet_service.cc:1467] Processing CreateTablet for tablet 4b43acb5622b42fca8211fdb491b5625 (DEFAULT_TABLE table=test-table [id=2197fda5f63943cfb2772b046bce6ac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:53.475090 27598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b43acb5622b42fca8211fdb491b5625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:53.475349 27744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b43acb5622b42fca8211fdb491b5625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:53.475457 27889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b43acb5622b42fca8211fdb491b5625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:53.481931 27981 tablet_bootstrap.cc:492] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: Bootstrap starting.
I20260808 08:29:53.483026 27982 tablet_bootstrap.cc:492] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: Bootstrap starting.
I20260808 08:29:53.484200 27983 tablet_bootstrap.cc:492] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: Bootstrap starting.
I20260808 08:29:53.485064 27981 tablet_bootstrap.cc:654] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:53.485065 27982 tablet_bootstrap.cc:654] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:53.485957 27982 log.cc:824] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:53.485957 27981 log.cc:824] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:53.486241 27983 tablet_bootstrap.cc:654] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:53.487107 27983 log.cc:824] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:53.487727 27981 tablet_bootstrap.cc:492] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: No bootstrap required, opened a new log
I20260808 08:29:53.487960 27981 ts_tablet_manager.cc:1397] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:29:53.487996 27982 tablet_bootstrap.cc:492] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: No bootstrap required, opened a new log
I20260808 08:29:53.488204 27982 ts_tablet_manager.cc:1397] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 08:29:53.489042 27983 tablet_bootstrap.cc:492] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: No bootstrap required, opened a new log
I20260808 08:29:53.489225 27983 ts_tablet_manager.cc:1397] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:29:53.491875 27981 raft_consensus.cc:348] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.492156 27981 raft_consensus.cc:374] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:53.492213 27981 raft_consensus.cc:729] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beddcd53e464c27a745fe600324286f, State: Initialized, Role: FOLLOWER
I20260808 08:29:53.492461 27982 raft_consensus.cc:348] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.492676 27982 raft_consensus.cc:374] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:53.492659 27981 consensus_queue.cc:260] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.492744 27982 raft_consensus.cc:729] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150bc2bd82cd4865be67a088e46684f9, State: Initialized, Role: FOLLOWER
I20260808 08:29:53.493048 27983 raft_consensus.cc:348] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.493156 27982 consensus_queue.cc:260] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.493280 27983 raft_consensus.cc:374] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:53.493343 27983 raft_consensus.cc:729] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb6e86c5ab494b09b9e400ea3c77363a, State: Initialized, Role: FOLLOWER
I20260808 08:29:53.493654 27981 ts_tablet_manager.cc:1428] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260808 08:29:53.493753 27983 consensus_queue.cc:260] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.494036 27812 heartbeater.cc:503] Master 127.25.170.62:42789 was elected leader, sending a full tablet report...
I20260808 08:29:53.494099 27982 ts_tablet_manager.cc:1428] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:29:53.494438 27666 heartbeater.cc:503] Master 127.25.170.62:42789 was elected leader, sending a full tablet report...
I20260808 08:29:53.494458 27956 heartbeater.cc:503] Master 127.25.170.62:42789 was elected leader, sending a full tablet report...
I20260808 08:29:53.495702 27983 ts_tablet_manager.cc:1428] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260808 08:29:53.657963 27957 tablet.cc:2369] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:29:53.667089 27813 tablet.cc:2369] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:29:53.690958 27667 tablet.cc:2369] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:29:53.758438 27987 raft_consensus.cc:482] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:29:53.758673 27987 raft_consensus.cc:504] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.759981 27987 leader_election.cc:288] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150bc2bd82cd4865be67a088e46684f9 (127.25.170.1:45369), fb6e86c5ab494b09b9e400ea3c77363a (127.25.170.3:37691)
I20260808 08:29:53.763975 27978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.760402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:53671 (local address 127.25.170.3:37691)
0808 08:29:53.760538 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.760544 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.760668 (+ 124us) server_negotiation.cc:407] Connection header received
0808 08:29:53.760823 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.760825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.760867 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.760964 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:53.761285 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.761786 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.762940 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.763375 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.763471 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.763554 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.763749 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.763828 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:29:53.763993 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.760250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:37691 (local address 127.25.170.2:53671)
0808 08:29:53.760556 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:53.760572 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:53.760710 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:53.761000 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:53.761006 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:53.761038 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:53.761144 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.761149 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.761928 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.761932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.762810 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.762820 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.763508 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.763511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.763603 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.763635 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 08:29:53.763708 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 08:29:53.763800 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":37,"spinlock_wait_cycles":1792,"thread_start_us":62,"threads_started":1}
I20260808 08:29:53.764045 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.760349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:47473 (local address 127.25.170.1:45369)
0808 08:29:53.760536 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.760541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.760558 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:29:53.760772 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.760778 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.760831 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.760900 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:53.761226 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.761772 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.762996 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.763406 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.763547 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.763600 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.763820 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.763924 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 08:29:53.764005 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.760137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45369 (local address 127.25.170.2:47473)
0808 08:29:53.760486 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:53.760501 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:53.760609 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:53.760944 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:53.760950 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:53.760971 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:53.761107 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.761113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.761892 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.761896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.762829 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:53.762839 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.763562 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.763567 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:53.763656 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.763675 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 08:29:53.763773 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 08:29:53.763849 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":4,"thread_start_us":93,"threads_started":1}
I20260808 08:29:53.764796 27910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b43acb5622b42fca8211fdb491b5625" candidate_uuid: "6beddcd53e464c27a745fe600324286f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" is_pre_election: true
I20260808 08:29:53.764797 27618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b43acb5622b42fca8211fdb491b5625" candidate_uuid: "6beddcd53e464c27a745fe600324286f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150bc2bd82cd4865be67a088e46684f9" is_pre_election: true
I20260808 08:29:53.765120 27618 raft_consensus.cc:2454] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6beddcd53e464c27a745fe600324286f in term 0.
I20260808 08:29:53.765120 27910 raft_consensus.cc:2454] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6beddcd53e464c27a745fe600324286f in term 0.
I20260808 08:29:53.765664 27693 leader_election.cc:302] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 150bc2bd82cd4865be67a088e46684f9, 6beddcd53e464c27a745fe600324286f, fb6e86c5ab494b09b9e400ea3c77363a; no voters:
I20260808 08:29:53.765972 27987 raft_consensus.cc:2781] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:29:53.766057 27987 raft_consensus.cc:482] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:29:53.766110 27987 raft_consensus.cc:3037] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:53.767202 27987 raft_consensus.cc:504] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.767554 27987 leader_election.cc:288] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [CANDIDATE]: Term 1 election: Requested vote from peers 150bc2bd82cd4865be67a088e46684f9 (127.25.170.1:45369), fb6e86c5ab494b09b9e400ea3c77363a (127.25.170.3:37691)
I20260808 08:29:53.767966 27910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b43acb5622b42fca8211fdb491b5625" candidate_uuid: "6beddcd53e464c27a745fe600324286f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb6e86c5ab494b09b9e400ea3c77363a"
I20260808 08:29:53.767971 27618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b43acb5622b42fca8211fdb491b5625" candidate_uuid: "6beddcd53e464c27a745fe600324286f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150bc2bd82cd4865be67a088e46684f9"
I20260808 08:29:53.768098 27910 raft_consensus.cc:3037] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:53.768098 27618 raft_consensus.cc:3037] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:53.769507 27618 raft_consensus.cc:2454] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beddcd53e464c27a745fe600324286f in term 1.
I20260808 08:29:53.769846 27695 leader_election.cc:302] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150bc2bd82cd4865be67a088e46684f9, 6beddcd53e464c27a745fe600324286f; no voters:
I20260808 08:29:53.770040 27910 raft_consensus.cc:2454] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beddcd53e464c27a745fe600324286f in term 1.
I20260808 08:29:53.770238 27987 raft_consensus.cc:2781] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:53.770478 27987 raft_consensus.cc:686] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 1 LEADER]: Becoming Leader. State: Replica: 6beddcd53e464c27a745fe600324286f, State: Running, Role: LEADER
I20260808 08:29:53.770807 27987 consensus_queue.cc:237] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.774231 27446 catalog_manager.cc:5495] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6beddcd53e464c27a745fe600324286f (127.25.170.2). New cstate: current_term: 1 leader_uuid: "6beddcd53e464c27a745fe600324286f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260808 08:29:53.839650 27977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:53.835754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41652 (local address 127.25.170.2:40997)
0808 08:29:53.835914 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:53.835917 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:53.835931 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:29:53.836168 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:53.836171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:53.836232 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:53.836342 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:53.836650 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.837152 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.838174 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:53.838386 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:53.838466 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:53.838793 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:53.839212 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:53.839309 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:53.839419 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 08:29:53.839471 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:29:53.845526 27618 raft_consensus.cc:1261] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9 [term 1 FOLLOWER]: Refusing update from remote peer 6beddcd53e464c27a745fe600324286f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:53.845525 27910 raft_consensus.cc:1261] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a [term 1 FOLLOWER]: Refusing update from remote peer 6beddcd53e464c27a745fe600324286f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:53.846226 27993 consensus_queue.cc:1035] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:53.846442 27987 consensus_queue.cc:1035] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [LEADER]: Connected to new peer: Peer: permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:53.856441 27999 mvcc.cc:205] Tried to move back new op lower bound from 7316184243583729664 to 7316184243288043520. Current Snapshot: MvccSnapshot[applied={T|T < 7316184243583729664}]
I20260808 08:29:53.866124 27446 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:29:53.866302 27446 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:29:53.868866 27446 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe: Sending DeleteTablet for 3 replicas of tablet 4b43acb5622b42fca8211fdb491b5625
I20260808 08:29:53.869720 27889 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b43acb5622b42fca8211fdb491b5625 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:53 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:47804
I20260808 08:29:53.869740 27744 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b43acb5622b42fca8211fdb491b5625 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:53 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:41638
I20260808 08:29:53.870162 27598 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b43acb5622b42fca8211fdb491b5625 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:53 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:38390
I20260808 08:29:53.870352 28008 tablet_replica.cc:330] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: stopping tablet replica
I20260808 08:29:53.870451 28009 tablet_replica.cc:330] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: stopping tablet replica
I20260808 08:29:53.870648 28008 raft_consensus.cc:2229] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:29:53.870891 28009 raft_consensus.cc:2229] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:29:53.870998 28008 raft_consensus.cc:2258] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:53.871342 28009 raft_consensus.cc:2258] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:53.871367 27446 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58914:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:29:53.871789 27446 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:29:53.872876 28010 tablet_replica.cc:330] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: stopping tablet replica
I20260808 08:29:53.873308 28010 raft_consensus.cc:2229] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:29:53.873801 28010 raft_consensus.cc:2258] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:53.875783 28008 ts_tablet_manager.cc:1905] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:53.877696 27744 tablet_service.cc:1467] Processing CreateTablet for tablet 465e1dfc9ca341cfad55128e4626f25a (DEFAULT_TABLE table=test-table [id=6aa12082447d4ee39def971063e2dae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:53.877975 27744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 465e1dfc9ca341cfad55128e4626f25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:53.877920 28010 ts_tablet_manager.cc:1905] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:53.879330 27598 tablet_service.cc:1467] Processing CreateTablet for tablet 465e1dfc9ca341cfad55128e4626f25a (DEFAULT_TABLE table=test-table [id=6aa12082447d4ee39def971063e2dae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:53.879566 27598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 465e1dfc9ca341cfad55128e4626f25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:53.880275 27981 tablet_bootstrap.cc:492] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f: Bootstrap starting.
I20260808 08:29:53.881219 28010 ts_tablet_manager.cc:1918] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:29:53.881323 28010 log.cc:1196] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/4b43acb5622b42fca8211fdb491b5625
I20260808 08:29:53.881327 27981 tablet_bootstrap.cc:654] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:53.881642 28010 ts_tablet_manager.cc:1939] T 4b43acb5622b42fca8211fdb491b5625 P 150bc2bd82cd4865be67a088e46684f9: Deleting consensus metadata
I20260808 08:29:53.882175 27889 tablet_service.cc:1467] Processing CreateTablet for tablet 465e1dfc9ca341cfad55128e4626f25a (DEFAULT_TABLE table=test-table [id=6aa12082447d4ee39def971063e2dae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:53.882462 27889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 465e1dfc9ca341cfad55128e4626f25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:53.882498 28009 ts_tablet_manager.cc:1905] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:53.884964 28008 ts_tablet_manager.cc:1918] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:29:53.885076 28008 log.cc:1196] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/4b43acb5622b42fca8211fdb491b5625
I20260808 08:29:53.885172 27982 tablet_bootstrap.cc:492] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9: Bootstrap starting.
I20260808 08:29:53.885423 28008 ts_tablet_manager.cc:1939] T 4b43acb5622b42fca8211fdb491b5625 P 6beddcd53e464c27a745fe600324286f: Deleting consensus metadata
I20260808 08:29:53.886190 27982 tablet_bootstrap.cc:654] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:53.886559 27434 catalog_manager.cc:4841] TS 6beddcd53e464c27a745fe600324286f (127.25.170.2:40997): tablet 4b43acb5622b42fca8211fdb491b5625 (table test-table [id=2197fda5f63943cfb2772b046bce6ac8]) successfully deleted
I20260808 08:29:53.886904 28009 ts_tablet_manager.cc:1918] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:29:53.887001 28009 log.cc:1196] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/4b43acb5622b42fca8211fdb491b5625
I20260808 08:29:53.886945 27435 catalog_manager.cc:4841] TS 150bc2bd82cd4865be67a088e46684f9 (127.25.170.1:45369): tablet 4b43acb5622b42fca8211fdb491b5625 (table test-table [id=2197fda5f63943cfb2772b046bce6ac8]) successfully deleted
I20260808 08:29:53.887226 27983 tablet_bootstrap.cc:492] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a: Bootstrap starting.
I20260808 08:29:53.887367 28009 ts_tablet_manager.cc:1939] T 4b43acb5622b42fca8211fdb491b5625 P fb6e86c5ab494b09b9e400ea3c77363a: Deleting consensus metadata
I20260808 08:29:53.888023 27982 tablet_bootstrap.cc:492] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9: No bootstrap required, opened a new log
I20260808 08:29:53.888098 27982 ts_tablet_manager.cc:1397] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 08:29:53.888427 27983 tablet_bootstrap.cc:654] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:53.888932 27433 catalog_manager.cc:4841] TS fb6e86c5ab494b09b9e400ea3c77363a (127.25.170.3:37691): tablet 4b43acb5622b42fca8211fdb491b5625 (table test-table [id=2197fda5f63943cfb2772b046bce6ac8]) successfully deleted
I20260808 08:29:53.889035 27981 tablet_bootstrap.cc:492] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f: No bootstrap required, opened a new log
I20260808 08:29:53.889111 27981 ts_tablet_manager.cc:1397] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20260808 08:29:53.889045 27982 raft_consensus.cc:348] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.889181 27982 raft_consensus.cc:374] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:53.889223 27982 raft_consensus.cc:729] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150bc2bd82cd4865be67a088e46684f9, State: Initialized, Role: FOLLOWER
I20260808 08:29:53.889344 27982 consensus_queue.cc:260] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.889616 27981 raft_consensus.cc:348] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.889701 27982 ts_tablet_manager.cc:1428] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:29:53.889717 27981 raft_consensus.cc:374] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:53.889748 27981 raft_consensus.cc:729] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beddcd53e464c27a745fe600324286f, State: Initialized, Role: FOLLOWER
I20260808 08:29:53.889854 27981 consensus_queue.cc:260] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.890080 27981 ts_tablet_manager.cc:1428] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:29:53.890499 27983 tablet_bootstrap.cc:492] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a: No bootstrap required, opened a new log
I20260808 08:29:53.890589 27983 ts_tablet_manager.cc:1397] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 08:29:53.891041 27983 raft_consensus.cc:348] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.891165 27983 raft_consensus.cc:374] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:53.891208 27983 raft_consensus.cc:729] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb6e86c5ab494b09b9e400ea3c77363a, State: Initialized, Role: FOLLOWER
I20260808 08:29:53.891364 27983 consensus_queue.cc:260] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:53.891702 27983 ts_tablet_manager.cc:1428] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 08:29:54.041097 27988 raft_consensus.cc:482] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:29:54.041266 27988 raft_consensus.cc:504] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.042423 27988 leader_election.cc:288] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6beddcd53e464c27a745fe600324286f (127.25.170.2:40997), fb6e86c5ab494b09b9e400ea3c77363a (127.25.170.3:37691)
I20260808 08:29:54.047144 27978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.042906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:38601 (local address 127.25.170.3:37691)
0808 08:29:54.043059 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:54.043066 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:54.043178 (+ 112us) server_negotiation.cc:407] Connection header received
0808 08:29:54.043254 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:54.043259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:54.043340 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:54.043430 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:54.043720 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.044615 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.046144 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.046529 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.046669 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.046733 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:54.046948 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 08:29:54.047032 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:29:54.047159 28015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.042739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:37691 (local address 127.25.170.1:38601)
0808 08:29:54.043078 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:54.043090 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:54.043176 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:54.043464 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:54.043467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:54.043486 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:54.043598 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:54.043604 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.044769 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.044772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:54.045969 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:54.045977 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.046664 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.046667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:54.046792 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.046816 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:29:54.046927 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 08:29:54.047004 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":48,"thread_start_us":135,"threads_started":1}
I20260808 08:29:54.047758 27977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.042785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:43257 (local address 127.25.170.2:40997)
0808 08:29:54.042946 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:54.042951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:54.043079 (+ 128us) server_negotiation.cc:407] Connection header received
0808 08:29:54.043304 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:54.043308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:54.043358 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:54.043460 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:54.043845 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.044427 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.046114 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.046894 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.047028 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.047106 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:54.047489 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 08:29:54.047595 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:29:54.048290 28014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.042594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:40997 (local address 127.25.170.1:43257)
0808 08:29:54.042990 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:54.043007 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:54.043168 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:54.043587 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:54.043589 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:54.043603 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:54.043719 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:54.043725 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.044553 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.044558 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:54.045964 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:54.045977 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.047176 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.047182 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:54.047328 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.047367 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 08:29:54.047950 (+ 583us) client_negotiation.cc:240] Negotiation successful
0808 08:29:54.048054 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"mutex_wait_us":36,"thread_start_us":112,"threads_started":1}
I20260808 08:29:54.048920 27910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "465e1dfc9ca341cfad55128e4626f25a" candidate_uuid: "150bc2bd82cd4865be67a088e46684f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" is_pre_election: true
I20260808 08:29:54.049008 27764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "465e1dfc9ca341cfad55128e4626f25a" candidate_uuid: "150bc2bd82cd4865be67a088e46684f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beddcd53e464c27a745fe600324286f" is_pre_election: true
I20260808 08:29:54.049156 27910 raft_consensus.cc:2454] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150bc2bd82cd4865be67a088e46684f9 in term 0.
I20260808 08:29:54.049315 27764 raft_consensus.cc:2454] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150bc2bd82cd4865be67a088e46684f9 in term 0.
I20260808 08:29:54.049798 27549 leader_election.cc:302] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150bc2bd82cd4865be67a088e46684f9, 6beddcd53e464c27a745fe600324286f; no voters:
I20260808 08:29:54.050094 27988 raft_consensus.cc:2781] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:29:54.050158 27988 raft_consensus.cc:482] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:29:54.050203 27988 raft_consensus.cc:3037] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:54.051285 27988 raft_consensus.cc:504] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.051662 27988 leader_election.cc:288] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [CANDIDATE]: Term 1 election: Requested vote from peers 6beddcd53e464c27a745fe600324286f (127.25.170.2:40997), fb6e86c5ab494b09b9e400ea3c77363a (127.25.170.3:37691)
I20260808 08:29:54.052045 27764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "465e1dfc9ca341cfad55128e4626f25a" candidate_uuid: "150bc2bd82cd4865be67a088e46684f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beddcd53e464c27a745fe600324286f"
I20260808 08:29:54.052124 27910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "465e1dfc9ca341cfad55128e4626f25a" candidate_uuid: "150bc2bd82cd4865be67a088e46684f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb6e86c5ab494b09b9e400ea3c77363a"
I20260808 08:29:54.052201 27764 raft_consensus.cc:3037] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:54.052284 27910 raft_consensus.cc:3037] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:54.053165 27764 raft_consensus.cc:2454] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150bc2bd82cd4865be67a088e46684f9 in term 1.
I20260808 08:29:54.053227 27910 raft_consensus.cc:2454] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150bc2bd82cd4865be67a088e46684f9 in term 1.
I20260808 08:29:54.053478 27549 leader_election.cc:302] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150bc2bd82cd4865be67a088e46684f9, 6beddcd53e464c27a745fe600324286f; no voters:
I20260808 08:29:54.053643 27988 raft_consensus.cc:2781] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:54.053862 27988 raft_consensus.cc:686] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 1 LEADER]: Becoming Leader. State: Replica: 150bc2bd82cd4865be67a088e46684f9, State: Running, Role: LEADER
I20260808 08:29:54.054136 27988 consensus_queue.cc:237] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.056605 27446 catalog_manager.cc:5495] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 150bc2bd82cd4865be67a088e46684f9 (127.25.170.1). New cstate: current_term: 1 leader_uuid: "150bc2bd82cd4865be67a088e46684f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } health_report { overall_health: UNKNOWN } } }
Aug 08 08:29:54 dist-test-slave-zkpd krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177792, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:54.114532 28024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.105611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:42789 (local address 127.0.0.1:58930)
0808 08:29:54.105999 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:54.106013 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:54.106153 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:54.106443 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:54.106445 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:54.106873 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:54.106979 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:54.106985 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.107738 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.107741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:54.108389 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:54.108399 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.108854 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.108857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:54.108927 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.109639 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:54.109651 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:54.111093 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:54.113043 (+ 1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:54.113052 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:54.113057 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:54.113320 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:54.113570 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:54.113572 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:54.113574 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:54.113653 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:54.114005 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:54.114010 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:54.114117 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 08:29:54.114211 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 08:29:54.114349 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":160,"threads_started":1}
I20260808 08:29:54.114558 28023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.105668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58930 (local address 127.25.170.62:42789)
0808 08:29:54.105950 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:54.105958 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:54.106120 (+ 162us) server_negotiation.cc:407] Connection header received
0808 08:29:54.106239 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:54.106241 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:54.106283 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:54.106399 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:54.107098 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.107636 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.108500 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.108712 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.108788 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.111219 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:54.111242 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:54.111246 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:54.111276 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:54.112941 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:54.113410 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:54.113412 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:54.113414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:54.113489 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:54.113748 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:54.113750 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:54.113751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:54.113919 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:54.113991 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:54.114271 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 08:29:54.114415 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":210,"thread_start_us":118,"threads_started":1}
I20260808 08:29:54.118570 27446 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:58930:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:29:54.119345 27446 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:29:54.124328 27598 tablet_service.cc:1467] Processing CreateTablet for tablet 0cf7c2b7ad0a4086ae64bbb903d5dec4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c4e0b9297c1148ecaaf9006ef3b47028]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:29:54.124526 27889 tablet_service.cc:1467] Processing CreateTablet for tablet 0cf7c2b7ad0a4086ae64bbb903d5dec4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c4e0b9297c1148ecaaf9006ef3b47028]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:29:54.124509 27744 tablet_service.cc:1467] Processing CreateTablet for tablet 0cf7c2b7ad0a4086ae64bbb903d5dec4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c4e0b9297c1148ecaaf9006ef3b47028]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:29:54.124797 27598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cf7c2b7ad0a4086ae64bbb903d5dec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:54.124892 27744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cf7c2b7ad0a4086ae64bbb903d5dec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:54.124892 27889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cf7c2b7ad0a4086ae64bbb903d5dec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:54.127574 27982 tablet_bootstrap.cc:492] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: Bootstrap starting.
I20260808 08:29:54.127774 27981 tablet_bootstrap.cc:492] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: Bootstrap starting.
I20260808 08:29:54.128156 27983 tablet_bootstrap.cc:492] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: Bootstrap starting.
I20260808 08:29:54.128675 27981 tablet_bootstrap.cc:654] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:54.128669 27982 tablet_bootstrap.cc:654] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:54.129123 27983 tablet_bootstrap.cc:654] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:54.130059 27981 tablet_bootstrap.cc:492] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: No bootstrap required, opened a new log
I20260808 08:29:54.130149 27981 ts_tablet_manager.cc:1397] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:29:54.130430 27983 tablet_bootstrap.cc:492] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: No bootstrap required, opened a new log
I20260808 08:29:54.130535 27983 ts_tablet_manager.cc:1397] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 08:29:54.130545 27981 raft_consensus.cc:348] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.130667 27981 raft_consensus.cc:374] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:54.130724 27981 raft_consensus.cc:729] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beddcd53e464c27a745fe600324286f, State: Initialized, Role: FOLLOWER
I20260808 08:29:54.130867 27981 consensus_queue.cc:260] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.131035 27983 raft_consensus.cc:348] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.131141 27981 ts_tablet_manager.cc:1428] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 08:29:54.131155 27983 raft_consensus.cc:374] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:54.131090 28004 tablet_replica.cc:439] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } } }
I20260808 08:29:54.131193 27983 raft_consensus.cc:729] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb6e86c5ab494b09b9e400ea3c77363a, State: Initialized, Role: FOLLOWER
I20260808 08:29:54.131228 28004 tablet_replica.cc:442] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:54.131328 27983 consensus_queue.cc:260] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.131582 27983 ts_tablet_manager.cc:1428] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:29:54.131625 27982 tablet_bootstrap.cc:492] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: No bootstrap required, opened a new log
I20260808 08:29:54.131714 27982 ts_tablet_manager.cc:1397] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 08:29:54.131799 27989 tablet_replica.cc:439] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } } }
I20260808 08:29:54.131976 27989 tablet_replica.cc:442] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:54.132185 27982 raft_consensus.cc:348] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.132278 27982 raft_consensus.cc:374] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:54.132300 27982 raft_consensus.cc:729] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150bc2bd82cd4865be67a088e46684f9, State: Initialized, Role: FOLLOWER
I20260808 08:29:54.132453 27982 consensus_queue.cc:260] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.132735 27988 tablet_replica.cc:439] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } } }
I20260808 08:29:54.132881 27988 tablet_replica.cc:442] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:54.132736 27982 ts_tablet_manager.cc:1428] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 08:29:54.198756 27988 raft_consensus.cc:482] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:29:54.198889 27988 raft_consensus.cc:504] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.199309 27988 leader_election.cc:288] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6beddcd53e464c27a745fe600324286f (127.25.170.2:40997), fb6e86c5ab494b09b9e400ea3c77363a (127.25.170.3:37691)
I20260808 08:29:54.199713 27764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf7c2b7ad0a4086ae64bbb903d5dec4" candidate_uuid: "150bc2bd82cd4865be67a088e46684f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beddcd53e464c27a745fe600324286f" is_pre_election: true
I20260808 08:29:54.199883 27764 raft_consensus.cc:2454] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150bc2bd82cd4865be67a088e46684f9 in term 0.
I20260808 08:29:54.199846 27910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf7c2b7ad0a4086ae64bbb903d5dec4" candidate_uuid: "150bc2bd82cd4865be67a088e46684f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" is_pre_election: true
I20260808 08:29:54.200016 27910 raft_consensus.cc:2454] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150bc2bd82cd4865be67a088e46684f9 in term 0.
I20260808 08:29:54.200207 27549 leader_election.cc:302] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150bc2bd82cd4865be67a088e46684f9, 6beddcd53e464c27a745fe600324286f; no voters:
I20260808 08:29:54.200390 27988 raft_consensus.cc:2781] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:29:54.200452 27988 raft_consensus.cc:482] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:29:54.200502 27988 raft_consensus.cc:3037] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:54.201634 27988 raft_consensus.cc:504] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.201982 27988 leader_election.cc:288] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [CANDIDATE]: Term 1 election: Requested vote from peers 6beddcd53e464c27a745fe600324286f (127.25.170.2:40997), fb6e86c5ab494b09b9e400ea3c77363a (127.25.170.3:37691)
I20260808 08:29:54.202298 27764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf7c2b7ad0a4086ae64bbb903d5dec4" candidate_uuid: "150bc2bd82cd4865be67a088e46684f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6beddcd53e464c27a745fe600324286f"
I20260808 08:29:54.202364 27910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf7c2b7ad0a4086ae64bbb903d5dec4" candidate_uuid: "150bc2bd82cd4865be67a088e46684f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb6e86c5ab494b09b9e400ea3c77363a"
I20260808 08:29:54.202419 27764 raft_consensus.cc:3037] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:54.202523 27910 raft_consensus.cc:3037] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:54.203442 27910 raft_consensus.cc:2454] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150bc2bd82cd4865be67a088e46684f9 in term 1.
I20260808 08:29:54.203454 27764 raft_consensus.cc:2454] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150bc2bd82cd4865be67a088e46684f9 in term 1.
I20260808 08:29:54.203740 27548 leader_election.cc:302] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150bc2bd82cd4865be67a088e46684f9, fb6e86c5ab494b09b9e400ea3c77363a; no voters:
I20260808 08:29:54.203943 27988 raft_consensus.cc:2781] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:54.204061 27988 raft_consensus.cc:686] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [term 1 LEADER]: Becoming Leader. State: Replica: 150bc2bd82cd4865be67a088e46684f9, State: Running, Role: LEADER
I20260808 08:29:54.204207 27988 consensus_queue.cc:237] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } }
I20260808 08:29:54.204960 28016 tablet_replica.cc:439] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: TxnStatusTablet state changed. Reason: New leader 150bc2bd82cd4865be67a088e46684f9. Latest consensus state: current_term: 1 leader_uuid: "150bc2bd82cd4865be67a088e46684f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } } }
I20260808 08:29:54.205080 28016 tablet_replica.cc:442] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:29:54.205750 28029 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:29:54.205907 28029 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:29:54.205976 27447 catalog_manager.cc:5495] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 150bc2bd82cd4865be67a088e46684f9 (127.25.170.1). New cstate: current_term: 1 leader_uuid: "150bc2bd82cd4865be67a088e46684f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } health_report { overall_health: UNKNOWN } } }
I20260808 08:29:54.233848 28024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.229663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45369 (local address 127.0.0.1:38404)
0808 08:29:54.229854 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:54.229874 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:54.229971 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:54.230303 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:54.230305 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:54.230311 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:29:54.230402 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:54.230406 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.231399 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.231401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:54.232076 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:54.232086 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.232652 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.232655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:54.232721 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.232793 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:29:54.233547 (+ 754us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:29:54.233562 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 08:29:54.233630 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 08:29:54.233719 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 08:29:54.233852 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.229807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38404 (local address 127.25.170.1:45369)
0808 08:29:54.229936 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:54.229940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:54.229957 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:29:54.230112 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:54.230116 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:54.230182 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:54.230282 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:54.230508 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.231295 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.232192 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.232534 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.232639 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.232938 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:54.233446 (+ 508us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:54.233563 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:54.233638 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 08:29:54.233691 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 08:29:54.236640 27910 raft_consensus.cc:1261] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a [term 1 FOLLOWER]: Refusing update from remote peer 150bc2bd82cd4865be67a088e46684f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:54.236819 27764 raft_consensus.cc:1261] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f [term 1 FOLLOWER]: Refusing update from remote peer 150bc2bd82cd4865be67a088e46684f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:54.237389 28016 consensus_queue.cc:1035] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:54.237601 27988 consensus_queue.cc:1035] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:54.239344 28004 tablet_replica.cc:439] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: TxnStatusTablet state changed. Reason: New leader 150bc2bd82cd4865be67a088e46684f9. Latest consensus state: current_term: 1 leader_uuid: "150bc2bd82cd4865be67a088e46684f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } } }
I20260808 08:29:54.239466 28004 tablet_replica.cc:442] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:54.240739 28016 tablet_replica.cc:439] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "150bc2bd82cd4865be67a088e46684f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } } }
I20260808 08:29:54.240857 28016 tablet_replica.cc:442] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:29:54.241050 27989 tablet_replica.cc:439] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: TxnStatusTablet state changed. Reason: New leader 150bc2bd82cd4865be67a088e46684f9. Latest consensus state: current_term: 1 leader_uuid: "150bc2bd82cd4865be67a088e46684f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } } }
I20260808 08:29:54.241169 27989 tablet_replica.cc:442] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:54.241284 27989 tablet_replica.cc:439] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "150bc2bd82cd4865be67a088e46684f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } } }
I20260808 08:29:54.241374 27989 tablet_replica.cc:442] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P fb6e86c5ab494b09b9e400ea3c77363a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:54.241490 27998 mvcc.cc:205] Tried to move back new op lower bound from 7316184245187932160 to 7316184245061681152. Current Snapshot: MvccSnapshot[applied={T|T < 7316184245187932160 or (T in {7316184245187932160})}]
I20260808 08:29:54.244397 28004 tablet_replica.cc:439] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "150bc2bd82cd4865be67a088e46684f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } } }
I20260808 08:29:54.244536 28004 tablet_replica.cc:442] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 6beddcd53e464c27a745fe600324286f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:54.244946 28034 tablet_replica.cc:439] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "150bc2bd82cd4865be67a088e46684f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150bc2bd82cd4865be67a088e46684f9" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45369 } } peers { permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 } } peers { permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 } } }
I20260808 08:29:54.245086 28034 tablet_replica.cc:442] T 0cf7c2b7ad0a4086ae64bbb903d5dec4 P 150bc2bd82cd4865be67a088e46684f9: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:29:54.249655 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.245814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38420 (local address 127.25.170.1:45369)
0808 08:29:54.245917 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:54.245921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:54.246191 (+ 270us) server_negotiation.cc:407] Connection header received
0808 08:29:54.246239 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:54.246242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:54.246301 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:54.246369 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:54.246719 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.247474 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.248598 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.248946 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.249044 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.249261 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:54.249336 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:54.249408 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:54.249481 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 08:29:54.249533 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 08:29:54.260157 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.256631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:35513 (local address 127.25.170.1:45369)
0808 08:29:54.256748 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:54.256754 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:54.257031 (+ 277us) server_negotiation.cc:407] Connection header received
0808 08:29:54.257187 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:54.257190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:54.257228 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:54.257322 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:54.257559 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.258022 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.259026 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.259236 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.259422 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.259713 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:54.259780 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:54.259853 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:54.259968 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 08:29:54.260018 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":43}
I20260808 08:29:54.260179 28038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.256587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45369 (local address 127.25.170.1:35513)
0808 08:29:54.256927 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:54.256944 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:54.257088 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:54.257342 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:54.257345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:54.257352 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:29:54.257463 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:54.257468 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.258124 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.258130 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:54.258906 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:54.258915 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.259421 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.259424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:54.259540 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.259584 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:29:54.259868 (+ 284us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:29:54.259876 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 08:29:54.259959 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 08:29:54.260035 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":2,"thread_start_us":104,"threads_started":1}
I20260808 08:29:54.266350 27910 raft_consensus.cc:1261] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a [term 1 FOLLOWER]: Refusing update from remote peer 150bc2bd82cd4865be67a088e46684f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:54.266350 27764 raft_consensus.cc:1261] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f [term 1 FOLLOWER]: Refusing update from remote peer 150bc2bd82cd4865be67a088e46684f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:54.266760 28034 consensus_queue.cc:1035] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb6e86c5ab494b09b9e400ea3c77363a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 37691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:54.266938 28016 consensus_queue.cc:1035] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6beddcd53e464c27a745fe600324286f" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:54.306277 27448 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:29:54.306442 27448 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:29:54.308545 27448 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a344d61a7844d86bbbcff5d6ac32fbe: Sending DeleteTablet for 3 replicas of tablet 465e1dfc9ca341cfad55128e4626f25a
I20260808 08:29:54.309126 27744 tablet_service.cc:1514] Processing DeleteTablet for tablet 465e1dfc9ca341cfad55128e4626f25a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:54 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:41638
I20260808 08:29:54.309185 27597 tablet_service.cc:1514] Processing DeleteTablet for tablet 465e1dfc9ca341cfad55128e4626f25a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:54 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:38390
I20260808 08:29:54.309350 28008 tablet_replica.cc:330] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f: stopping tablet replica
I20260808 08:29:54.309360 27889 tablet_service.cc:1514] Processing DeleteTablet for tablet 465e1dfc9ca341cfad55128e4626f25a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:54 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:47804
I20260808 08:29:54.309477 28008 raft_consensus.cc:2229] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:29:54.309536 28010 tablet_replica.cc:330] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9: stopping tablet replica
I20260808 08:29:54.309536 28009 tablet_replica.cc:330] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a: stopping tablet replica
I20260808 08:29:54.309587 28008 raft_consensus.cc:2258] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:54.309634 28010 raft_consensus.cc:2229] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:29:54.309656 28009 raft_consensus.cc:2229] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:29:54.309780 28009 raft_consensus.cc:2258] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:54.309913 28010 raft_consensus.cc:2258] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:54.310562 28008 ts_tablet_manager.cc:1905] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:54.310595 28010 ts_tablet_manager.cc:1905] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:54.310673 28009 ts_tablet_manager.cc:1905] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:54.313406 28010 ts_tablet_manager.cc:1918] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:29:54.313406 28008 ts_tablet_manager.cc:1918] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:29:54.313432 28009 ts_tablet_manager.cc:1918] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:29:54.313478 28008 log.cc:1196] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/465e1dfc9ca341cfad55128e4626f25a
I20260808 08:29:54.313478 28010 log.cc:1196] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/465e1dfc9ca341cfad55128e4626f25a
I20260808 08:29:54.313498 28009 log.cc:1196] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/465e1dfc9ca341cfad55128e4626f25a
I20260808 08:29:54.313773 28008 ts_tablet_manager.cc:1939] T 465e1dfc9ca341cfad55128e4626f25a P 6beddcd53e464c27a745fe600324286f: Deleting consensus metadata
I20260808 08:29:54.313791 28010 ts_tablet_manager.cc:1939] T 465e1dfc9ca341cfad55128e4626f25a P 150bc2bd82cd4865be67a088e46684f9: Deleting consensus metadata
I20260808 08:29:54.313793 28009 ts_tablet_manager.cc:1939] T 465e1dfc9ca341cfad55128e4626f25a P fb6e86c5ab494b09b9e400ea3c77363a: Deleting consensus metadata
I20260808 08:29:54.314570 27435 catalog_manager.cc:4841] TS 150bc2bd82cd4865be67a088e46684f9 (127.25.170.1:45369): tablet 465e1dfc9ca341cfad55128e4626f25a (table test-table [id=6aa12082447d4ee39def971063e2dae1]) successfully deleted
I20260808 08:29:54.315085 27433 catalog_manager.cc:4841] TS fb6e86c5ab494b09b9e400ea3c77363a (127.25.170.3:37691): tablet 465e1dfc9ca341cfad55128e4626f25a (table test-table [id=6aa12082447d4ee39def971063e2dae1]) successfully deleted
I20260808 08:29:54.315488 27434 catalog_manager.cc:4841] TS 6beddcd53e464c27a745fe600324286f (127.25.170.2:40997): tablet 465e1dfc9ca341cfad55128e4626f25a (table test-table [id=6aa12082447d4ee39def971063e2dae1]) successfully deleted
Aug 08 08:29:54 dist-test-slave-zkpd krb5kdc[27401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177793, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:29:54.324800 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.310539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38424 (local address 127.25.170.1:45369)
0808 08:29:54.310646 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:54.310650 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:54.314198 (+ 3548us) server_negotiation.cc:407] Connection header received
0808 08:29:54.314399 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:54.314402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:54.314451 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:54.314540 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:54.315793 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.316579 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.317476 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.317826 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.317935 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.320996 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:54.321006 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:54.321020 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:54.321046 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:54.322931 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:54.323356 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:54.323362 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:54.323364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:54.323475 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:54.323743 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:54.323747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:54.323748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:54.324071 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:54.324277 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:54.324506 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 08:29:54.324630 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 08:29:54.325215 27660 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38424
I20260808 08:29:54.335062 28023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:54.327034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58946 (local address 127.25.170.62:42789)
0808 08:29:54.327185 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:54.327191 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:54.327311 (+ 120us) server_negotiation.cc:407] Connection header received
0808 08:29:54.327392 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:54.327395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:54.327444 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:54.327529 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:54.328190 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.328970 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.329755 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:54.330144 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:54.330263 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:54.331538 (+ 1275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:54.331542 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:54.331544 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:54.331571 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:54.333358 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:54.333780 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:54.333784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:54.333786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:54.333886 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:54.334142 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:54.334145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:54.334147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:54.334377 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:54.334520 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:54.334737 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 08:29:54.334906 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 08:29:54.335481 27448 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58946
I20260808 08:29:54.336886 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 27529
I20260808 08:29:54.346839 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 27675
I20260808 08:29:54.355302 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 27821
I20260808 08:29:54.362483 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 27414
2026-08-08T08:29:54Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3118 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:29:54 dist-test-slave-zkpd krb5kdc[28050](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:29:54 dist-test-slave-zkpd krb5kdc[28050](info): set up 2 sockets
Aug 08 08:29:54 dist-test-slave-zkpd krb5kdc[28050](info): commencing operation
krb5kdc: starting...
W20260808 08:29:55.433573 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:29:55 dist-test-slave-zkpd krb5kdc[28050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:29:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:29:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:29:55.557062 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:36335
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:36335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:55.666718 28064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:55.667021 28064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:55.667102 28064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:55.671060 28064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:29:55.671155 28064 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:29:55.671187 28064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:55.671228 28064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:55.671262 28064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:29:55.671289 28064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:29:55.676409 28064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:36335
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:36335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:55.677416 28064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:55.678424 28064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:55.686794 28069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:55.686847 28070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:55.686847 28072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:55.687005 28064 server_base.cc:1034] running on GCE node
I20260808 08:29:55.687562 28064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:55.688676 28064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:55.689868 28064 hybrid_clock.cc:648] HybridClock initialized: now 1786177795689851 us; error 30 us; skew 500 ppm
Aug 08 08:29:55 dist-test-slave-zkpd krb5kdc[28050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177795, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:55.692541 28064 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:29:55.693293 28064 webserver.cc:460] Webserver started at http://127.25.170.62:37273/ using document root <none> and password file <none>
I20260808 08:29:55.693790 28064 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:55.693847 28064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:55.694003 28064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:55.695859 28064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "bbbde8a0c82c40d18deb072d496a816f"
format_stamp: "Formatted at 2026-08-08 08:29:55 on dist-test-slave-zkpd"
server_key: "f5fcd7883f7927c67b6be47c130985c5"
server_key_iv: "c4cc2041fe922311ff29371c88b4dc28"
server_key_version: "encryptionkey@0"
I20260808 08:29:55.696456 28064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "bbbde8a0c82c40d18deb072d496a816f"
format_stamp: "Formatted at 2026-08-08 08:29:55 on dist-test-slave-zkpd"
server_key: "f5fcd7883f7927c67b6be47c130985c5"
server_key_iv: "c4cc2041fe922311ff29371c88b4dc28"
server_key_version: "encryptionkey@0"
I20260808 08:29:55.699852 28064 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:29:55.702103 28079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:55.703269 28064 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:29:55.703408 28064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "bbbde8a0c82c40d18deb072d496a816f"
format_stamp: "Formatted at 2026-08-08 08:29:55 on dist-test-slave-zkpd"
server_key: "f5fcd7883f7927c67b6be47c130985c5"
server_key_iv: "c4cc2041fe922311ff29371c88b4dc28"
server_key_version: "encryptionkey@0"
I20260808 08:29:55.703509 28064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:55.716974 28064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:55.719578 28064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:55.719769 28064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:55.727671 28064 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:36335
I20260808 08:29:55.727684 28147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:36335 every 8 connection(s)
I20260808 08:29:55.728615 28064 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:29:55.731299 28148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:55.732685 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 28064
I20260808 08:29:55.732781 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:29:55.733059 26280 external_mini_cluster.cc:1428] Setting key dfd6fda215530dec5141ce563923afef
I20260808 08:29:55.737953 28148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f: Bootstrap starting.
I20260808 08:29:55.740564 28148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:55.741298 28148 log.cc:824] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:29:55 dist-test-slave-zkpd krb5kdc[28050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:55.743546 28148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f: No bootstrap required, opened a new log
I20260808 08:29:55.747550 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:55.734443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53106 (local address 127.25.170.62:36335)
0808 08:29:55.734864 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:55.734884 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:55.734929 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:29:55.735727 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:55.735764 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:55.736211 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:55.736571 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:55.737215 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:55.738624 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:55.739453 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:55.740169 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:55.740331 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:55.743035 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:55.743040 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:55.743052 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:55.743076 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:55.744800 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:55.745295 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:55.745299 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:55.745304 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:55.745410 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:55.745700 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:55.745702 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:55.745703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:55.746065 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:55.746203 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:55.746526 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 08:29:55.746817 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":100,"threads_started":1}
I20260808 08:29:55.747576 28148 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbde8a0c82c40d18deb072d496a816f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 36335 } }
I20260808 08:29:55.747884 28148 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:55.747977 28148 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbbde8a0c82c40d18deb072d496a816f, State: Initialized, Role: FOLLOWER
I20260808 08:29:55.748440 28148 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbde8a0c82c40d18deb072d496a816f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 36335 } }
I20260808 08:29:55.748603 28148 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:29:55.748677 28148 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:29:55.748811 28148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:55.749863 28148 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbde8a0c82c40d18deb072d496a816f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 36335 } }
I20260808 08:29:55.750208 28148 leader_election.cc:302] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbbde8a0c82c40d18deb072d496a816f; no voters:
I20260808 08:29:55.750459 28148 leader_election.cc:288] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:29:55.750604 28153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:55.750852 28153 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [term 1 LEADER]: Becoming Leader. State: Replica: bbbde8a0c82c40d18deb072d496a816f, State: Running, Role: LEADER
I20260808 08:29:55.751166 28153 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbde8a0c82c40d18deb072d496a816f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 36335 } }
I20260808 08:29:55.751639 28148 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:29:55.752951 28154 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbbde8a0c82c40d18deb072d496a816f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbde8a0c82c40d18deb072d496a816f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 36335 } } }
I20260808 08:29:55.752977 28155 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbbde8a0c82c40d18deb072d496a816f. Latest consensus state: current_term: 1 leader_uuid: "bbbde8a0c82c40d18deb072d496a816f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbbde8a0c82c40d18deb072d496a816f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 36335 } } }
I20260808 08:29:55.753207 28154 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [sys.catalog]: This master's current role is: LEADER
I20260808 08:29:55.753233 28155 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f [sys.catalog]: This master's current role is: LEADER
I20260808 08:29:55.754027 28164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:29:55.756726 28164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:29:55.761515 28164 catalog_manager.cc:1347] Generated new cluster ID: 4c665f59e9244e7fbda3c42db595ad74
I20260808 08:29:55.761572 28164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:29:55.785308 28164 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:29:55.786213 28164 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:29:55.796118 28164 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f: Generated new TSK 0
I20260808 08:29:55.796777 28164 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:29:55.830453 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:36335
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:55.945951 28176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:55.946178 28176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:55.946245 28176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:55.950193 28176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:55.950241 28176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:55.950320 28176 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:29:55.950356 28176 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:29:55.950415 28176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:29:55.955652 28176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.170.62:36335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:55.956632 28176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:55.957609 28176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:55.967085 28182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:55.967110 28183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:55.967152 28176 server_base.cc:1034] running on GCE node
W20260808 08:29:55.967079 28185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:55.967784 28176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:55.968449 28176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:55.969641 28176 hybrid_clock.cc:648] HybridClock initialized: now 1786177795969609 us; error 43 us; skew 500 ppm
Aug 08 08:29:55 dist-test-slave-zkpd krb5kdc[28050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177795, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:55.972807 28176 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:29:55.973626 28176 webserver.cc:460] Webserver started at http://127.25.170.1:37095/ using document root <none> and password file <none>
I20260808 08:29:55.974233 28176 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:55.974325 28176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:55.974551 28176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:55.976913 28176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "4bbae82cedcc45eebbe69b574c6d969b"
format_stamp: "Formatted at 2026-08-08 08:29:55 on dist-test-slave-zkpd"
server_key: "418567c14dd8e7851ddcce0c64d414de"
server_key_iv: "c580e455d3da68aa1af4087b87457ce4"
server_key_version: "encryptionkey@0"
I20260808 08:29:55.977619 28176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "4bbae82cedcc45eebbe69b574c6d969b"
format_stamp: "Formatted at 2026-08-08 08:29:55 on dist-test-slave-zkpd"
server_key: "418567c14dd8e7851ddcce0c64d414de"
server_key_iv: "c580e455d3da68aa1af4087b87457ce4"
server_key_version: "encryptionkey@0"
I20260808 08:29:55.981456 28176 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:29:55.983801 28192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:55.985100 28176 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:29:55.985237 28176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "4bbae82cedcc45eebbe69b574c6d969b"
format_stamp: "Formatted at 2026-08-08 08:29:55 on dist-test-slave-zkpd"
server_key: "418567c14dd8e7851ddcce0c64d414de"
server_key_iv: "c580e455d3da68aa1af4087b87457ce4"
server_key_version: "encryptionkey@0"
I20260808 08:29:55.985354 28176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:55.996322 28176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:55.998914 28176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:55.999100 28176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:56.000604 28176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:56.000674 28176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:56.000742 28176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:56.000792 28176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:29:56 dist-test-slave-zkpd krb5kdc[28050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177795, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:56.012053 28176 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:45481
I20260808 08:29:56.012115 28314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:45481 every 8 connection(s)
I20260808 08:29:56.013094 28176 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:29:56.015064 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.001268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:52987 (local address 127.25.170.62:36335)
0808 08:29:56.001413 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.001416 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.002390 (+ 974us) server_negotiation.cc:407] Connection header received
0808 08:29:56.003452 (+ 1062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.003456 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.003519 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.003617 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:56.005412 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.006037 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.007400 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.007812 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.007963 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.011294 (+ 3331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:56.011297 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:56.011300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:56.011325 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:56.012931 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.013572 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.013576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.013578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.013671 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.014106 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.014109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.014111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.014318 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:56.014403 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.014831 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.014940 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:29:56.015878 28202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.001771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:36335 (local address 127.25.170.1:52987)
0808 08:29:56.002234 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.002274 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.003207 (+ 933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.003994 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.004004 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.004536 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:56.005216 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.005240 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.006162 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.006165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.007257 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.007268 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.008010 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.008014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.008193 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.008782 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:56.008823 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:56.011112 (+ 2289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:56.013048 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.013057 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.013074 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.013458 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.013808 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.013811 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.013813 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.013990 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.014419 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:56.014424 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:56.014624 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.014772 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.014998 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":126,"threads_started":1}
I20260808 08:29:56.017231 28315 heartbeater.cc:347] Connected to a master server at 127.25.170.62:36335
I20260808 08:29:56.017366 28315 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:56.017913 28315 heartbeater.cc:511] Master 127.25.170.62:36335 requested a full tablet report, sending...
I20260808 08:29:56.019469 28098 ts_manager.cc:194] Registered new tserver with Master: 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481)
I20260808 08:29:56.020084 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 28176
I20260808 08:29:56.020191 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:29:56.020503 26280 external_mini_cluster.cc:1428] Setting key 6baf4deb67f2cdaf37f6e4264efe3ef4
I20260808 08:29:56.021066 28098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:52987
I20260808 08:29:56.027108 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.019462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:57541 (local address 127.25.170.62:36335)
0808 08:29:56.019593 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.019599 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.019794 (+ 195us) server_negotiation.cc:407] Connection header received
0808 08:29:56.019945 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.019948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.019995 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.020079 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:56.020494 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.021089 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.022127 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.022519 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.022639 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.023826 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:56.023832 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:56.023837 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:56.023871 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:56.025424 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.025926 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.025929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.025930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.026001 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.026303 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.026305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.026306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.026460 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:56.026535 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.026890 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.026995 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:29:56.027231 28321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.019398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:36335 (local address 127.25.170.1:57541)
0808 08:29:56.019714 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.019726 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.019840 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.020095 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.020098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.020287 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:56.020381 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.020386 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.021214 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.021218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.022001 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.022011 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.022653 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.022657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.022745 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.023298 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:56.023315 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:56.023663 (+ 348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:56.025543 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.025549 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.025554 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.025826 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.026092 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.026098 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.026103 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.026207 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.026566 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:56.026573 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:56.026689 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.026813 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.026983 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":96,"threads_started":1}
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:29:56.048866 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:36335
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:56.163604 28325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:56.163911 28325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:56.164022 28325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:56.168131 28325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:56.168183 28325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:56.168222 28325 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:29:56.168236 28325 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:29:56.168311 28325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:29:56.173585 28325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.170.62:36335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:56.174649 28325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:56.175653 28325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:56.184914 28333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:56.184906 28330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:56.185055 28325 server_base.cc:1034] running on GCE node
W20260808 08:29:56.184912 28331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:56.185643 28325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:56.186240 28325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:56.187431 28325 hybrid_clock.cc:648] HybridClock initialized: now 1786177796187412 us; error 30 us; skew 500 ppm
Aug 08 08:29:56 dist-test-slave-zkpd krb5kdc[28050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177796, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:56.190248 28325 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:29:56.191039 28325 webserver.cc:460] Webserver started at http://127.25.170.2:44087/ using document root <none> and password file <none>
I20260808 08:29:56.191576 28325 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:56.191666 28325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:56.191951 28325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:56.193969 28325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "98cb75ef2647456b9c79133a74a5d142"
format_stamp: "Formatted at 2026-08-08 08:29:56 on dist-test-slave-zkpd"
server_key: "a47d99f30208d7277b7f562b81ce3a57"
server_key_iv: "b2419cb4699dd0678abed8e3273ec38c"
server_key_version: "encryptionkey@0"
I20260808 08:29:56.194536 28325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "98cb75ef2647456b9c79133a74a5d142"
format_stamp: "Formatted at 2026-08-08 08:29:56 on dist-test-slave-zkpd"
server_key: "a47d99f30208d7277b7f562b81ce3a57"
server_key_iv: "b2419cb4699dd0678abed8e3273ec38c"
server_key_version: "encryptionkey@0"
I20260808 08:29:56.198122 28325 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:29:56.200454 28340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:56.201666 28325 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:29:56.201808 28325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "98cb75ef2647456b9c79133a74a5d142"
format_stamp: "Formatted at 2026-08-08 08:29:56 on dist-test-slave-zkpd"
server_key: "a47d99f30208d7277b7f562b81ce3a57"
server_key_iv: "b2419cb4699dd0678abed8e3273ec38c"
server_key_version: "encryptionkey@0"
I20260808 08:29:56.201917 28325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:56.216075 28325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:56.218940 28325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:56.219129 28325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:56.220551 28325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:56.220624 28325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:56.220695 28325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:56.220747 28325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:29:56 dist-test-slave-zkpd krb5kdc[28050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177796, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:56.232425 28325 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:43777
I20260808 08:29:56.232522 28459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:43777 every 8 connection(s)
I20260808 08:29:56.233521 28325 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:29:56.234905 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.221693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:47991 (local address 127.25.170.62:36335)
0808 08:29:56.221869 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.221875 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.222792 (+ 917us) server_negotiation.cc:407] Connection header received
0808 08:29:56.223937 (+ 1145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.223940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.224008 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.224106 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:56.225469 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.226266 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.227546 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.227788 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.227936 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.230924 (+ 2988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:56.230928 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:56.230933 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:56.230964 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:56.232722 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.233308 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.233311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.233312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.233388 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.233783 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.233786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.233787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.234017 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:56.234117 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.234679 (+ 562us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.234784 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:29:56.235139 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 28325
I20260808 08:29:56.235270 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:29:56.235574 26280 external_mini_cluster.cc:1428] Setting key 8e57b3d92822fd0d51557c01abe4107d
I20260808 08:29:56.235929 28349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.222158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:36335 (local address 127.25.170.2:47991)
0808 08:29:56.222635 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.222676 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.223640 (+ 964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.224304 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.224313 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.224649 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:56.225312 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.225329 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.226406 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.226410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.227404 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.227415 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.227999 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.228005 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.228243 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.228840 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:56.228863 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:56.230710 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:56.232841 (+ 2131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.232846 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.232858 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.233202 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.233483 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.233489 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.233494 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.233662 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.234172 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:56.234178 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:56.234471 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.234626 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.234862 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":138,"threads_started":1}
I20260808 08:29:56.237200 28460 heartbeater.cc:347] Connected to a master server at 127.25.170.62:36335
I20260808 08:29:56.237380 28460 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:56.237861 28460 heartbeater.cc:511] Master 127.25.170.62:36335 requested a full tablet report, sending...
I20260808 08:29:56.238909 28098 ts_manager.cc:194] Registered new tserver with Master: 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2:43777)
I20260808 08:29:56.239632 28098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:47991
I20260808 08:29:56.247228 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.239961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:35357 (local address 127.25.170.62:36335)
0808 08:29:56.240074 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.240078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.240088 (+ 10us) server_negotiation.cc:407] Connection header received
0808 08:29:56.240127 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.240129 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.240162 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.240249 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:56.240787 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.241348 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.242453 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.242653 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.242732 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.244050 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:56.244053 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:56.244055 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:56.244076 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:56.245489 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.245972 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.245975 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.245976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.246045 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.246353 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.246356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.246357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.246540 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:56.246616 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.246962 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.247091 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:29:56.247268 28468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.239584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:36335 (local address 127.25.170.2:35357)
0808 08:29:56.239858 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.239873 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.239981 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.240274 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.240277 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.240502 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:56.240628 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.240636 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.241485 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.241489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.242328 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.242343 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.242778 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.242785 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.242913 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.243368 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:56.243389 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:56.243916 (+ 527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:56.245607 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.245612 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.245614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.245874 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.246139 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.246142 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.246144 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.246245 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.246644 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:56.246648 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:56.246759 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.246880 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.247028 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:29:56.267117 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:36335
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:29:56.379499 28470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:29:56.379808 28470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:29:56.379914 28470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:29:56.383996 28470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:29:56.384068 28470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:29:56.384135 28470 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:29:56.384178 28470 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:29:56.384245 28470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:29:56.389592 28470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.170.62:36335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:29:56.390659 28470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:29:56.391742 28470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:29:56.401355 28475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:56.401459 28478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:29:56.401496 28476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:29:56.401554 28470 server_base.cc:1034] running on GCE node
I20260808 08:29:56.401986 28470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:29:56.402577 28470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:29:56.403764 28470 hybrid_clock.cc:648] HybridClock initialized: now 1786177796403754 us; error 37 us; skew 500 ppm
Aug 08 08:29:56 dist-test-slave-zkpd krb5kdc[28050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177796, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:29:56.406725 28470 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:29:56.407608 28470 webserver.cc:460] Webserver started at http://127.25.170.3:42133/ using document root <none> and password file <none>
I20260808 08:29:56.408202 28470 fs_manager.cc:359] Metadata directory not provided
I20260808 08:29:56.408293 28470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:29:56.408519 28470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:29:56.410461 28470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "173328857f834b2d9b43280c60b50daf"
format_stamp: "Formatted at 2026-08-08 08:29:56 on dist-test-slave-zkpd"
server_key: "0086b60b1974806e2834be5638204085"
server_key_iv: "a9eff61af36d7c733d7f01c9b7393bbd"
server_key_version: "encryptionkey@0"
I20260808 08:29:56.411032 28470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "173328857f834b2d9b43280c60b50daf"
format_stamp: "Formatted at 2026-08-08 08:29:56 on dist-test-slave-zkpd"
server_key: "0086b60b1974806e2834be5638204085"
server_key_iv: "a9eff61af36d7c733d7f01c9b7393bbd"
server_key_version: "encryptionkey@0"
I20260808 08:29:56.414651 28470 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260808 08:29:56.417233 28485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:56.418541 28470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:29:56.418642 28470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "173328857f834b2d9b43280c60b50daf"
format_stamp: "Formatted at 2026-08-08 08:29:56 on dist-test-slave-zkpd"
server_key: "0086b60b1974806e2834be5638204085"
server_key_iv: "a9eff61af36d7c733d7f01c9b7393bbd"
server_key_version: "encryptionkey@0"
I20260808 08:29:56.418722 28470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:29:56.435482 28470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:29:56.438776 28470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:29:56.438936 28470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:29:56.440343 28470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:29:56.440394 28470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:29:56.440434 28470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:29:56.440488 28470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:29:56 dist-test-slave-zkpd krb5kdc[28050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177796, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:56.451596 28470 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:38771
I20260808 08:29:56.451654 28604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:38771 every 8 connection(s)
I20260808 08:29:56.452759 28470 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:29:56.454159 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 28470
I20260808 08:29:56.454288 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:29:56.454648 26280 external_mini_cluster.cc:1428] Setting key 2aac9c21335eaa44021e947c120a6aaf
I20260808 08:29:56.456343 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.441228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:41939 (local address 127.25.170.62:36335)
0808 08:29:56.441398 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.441405 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.442629 (+ 1224us) server_negotiation.cc:407] Connection header received
0808 08:29:56.443918 (+ 1289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.443923 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.443994 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.444095 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:56.445737 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.446652 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.448473 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.448856 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.448994 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.451950 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:56.451954 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:56.451957 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:56.451989 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:56.453808 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.454442 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.454446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.454449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.454545 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.455020 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.455025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.455027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.455260 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:56.455361 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.456039 (+ 678us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.456224 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:29:56.457216 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.441988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:36335 (local address 127.25.170.3:41939)
0808 08:29:56.442447 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.442496 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.443632 (+ 1136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.444291 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.444302 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.444835 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:56.445583 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.445603 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.446802 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.446809 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.448346 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.448356 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.449022 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.449025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.449161 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.449884 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:56.449902 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:56.451749 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:56.453933 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.453941 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.453954 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.454309 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.454679 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.454682 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.454684 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.454910 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.455395 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:56.455402 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:56.455695 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.455949 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.456322 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":136,"threads_started":1}
I20260808 08:29:56.458436 28605 heartbeater.cc:347] Connected to a master server at 127.25.170.62:36335
I20260808 08:29:56.458598 28605 heartbeater.cc:464] Registering TS with master...
I20260808 08:29:56.459158 28605 heartbeater.cc:511] Master 127.25.170.62:36335 requested a full tablet report, sending...
I20260808 08:29:56.460206 28099 ts_manager.cc:194] Registered new tserver with Master: 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771)
I20260808 08:29:56.461035 28099 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:41939
I20260808 08:29:56.466959 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.460484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:36051 (local address 127.25.170.62:36335)
0808 08:29:56.460607 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.460611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.460778 (+ 167us) server_negotiation.cc:407] Connection header received
0808 08:29:56.460854 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.460857 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.460897 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.460968 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:56.461452 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.461948 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.462786 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.463019 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.463129 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.464155 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:56.464159 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:56.464205 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:56.464226 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:56.465372 (+ 1146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.465783 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.465787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.465788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.465885 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.466168 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.466172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.466173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.466339 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:56.466445 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.466709 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.466822 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:29:56.466969 28611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.460429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:36335 (local address 127.25.170.3:36051)
0808 08:29:56.460686 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.460708 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.460789 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.460982 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.460984 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.461137 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:56.461311 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.461322 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.462077 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.462080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.462664 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.462672 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.463135 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.463138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.463242 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.463654 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:56.463665 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:56.464028 (+ 363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:56.465484 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.465488 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.465490 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.465682 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.465984 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.465987 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.465989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.466075 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.466438 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:56.466442 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:56.466539 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.466645 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.466776 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":1,"thread_start_us":106,"threads_started":1}
I20260808 08:29:56.468621 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:29:56 dist-test-slave-zkpd krb5kdc[28050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:29:56 dist-test-slave-zkpd krb5kdc[28050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:56.494693 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.486574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53112 (local address 127.25.170.62:36335)
0808 08:29:56.486733 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.486737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.486750 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:29:56.486792 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.486794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.486835 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.486911 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:56.487564 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.488192 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.489040 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.489255 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.489370 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.491712 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:56.491716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:56.491718 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:56.491742 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:56.493070 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.493488 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.493492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.493494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.493582 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.493879 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.493883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.493885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.494053 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:56.494195 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.494419 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.494535 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:29:56.497424 28098 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:29:56.500581 28098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:29:56.515309 28624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.509157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:43777 (local address 127.0.0.1:52652)
0808 08:29:56.509942 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.509996 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.510144 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.510947 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.510952 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.510984 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:56.511147 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.511153 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.512334 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.512340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.513497 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.513507 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.514717 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.514721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.514851 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.514895 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.515009 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.515140 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"mutex_wait_us":30,"spinlock_wait_cycles":8320,"thread_start_us":116,"threads_started":1}
I20260808 08:29:56.515375 28625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.509242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47616 (local address 127.25.170.1:45481)
0808 08:29:56.510467 (+ 1225us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.510483 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.510511 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:29:56.510574 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.510578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.510784 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.510942 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:56.511328 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.512504 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.513976 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.514748 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.514866 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.515038 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.515144 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.515236 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1115,"thread_start_us":86,"threads_started":1}
I20260808 08:29:56.515825 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.509897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52652 (local address 127.25.170.2:43777)
0808 08:29:56.510463 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.510475 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.510499 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:29:56.510576 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.510582 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.510787 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.510959 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:56.511287 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.512220 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.513610 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.514378 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.514487 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.514646 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.515570 (+ 924us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.515678 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":127,"threads_started":1}
I20260808 08:29:56.515323 28626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.509075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45481 (local address 127.0.0.1:47616)
0808 08:29:56.509942 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.509996 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.510144 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.510948 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.510954 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.510989 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:56.511174 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.511182 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.512635 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.512639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.513839 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.513851 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.514884 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.514888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.514999 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.515024 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.515104 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.515168 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":75,"spinlock_wait_cycles":24192,"thread_start_us":94,"threads_started":1}
I20260808 08:29:56.516192 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.509716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46146 (local address 127.25.170.3:38771)
0808 08:29:56.510199 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.510214 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.511380 (+ 1166us) server_negotiation.cc:407] Connection header received
0808 08:29:56.511464 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.511469 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.511633 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.511776 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:56.512063 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.513159 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.514459 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.515269 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.515393 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.515547 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.515924 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.516042 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":155,"threads_started":1}
I20260808 08:29:56.516145 28623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.509447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:38771 (local address 127.0.0.1:46146)
0808 08:29:56.511183 (+ 1736us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.511197 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.511282 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.511789 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.511792 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.511813 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:56.511936 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.511942 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.513287 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.513291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.514339 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.514348 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.515611 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.515615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.515722 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.515741 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.515802 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.515851 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1676,"mutex_wait_us":18,"thread_start_us":84,"threads_started":1}
I20260808 08:29:56.518735 28246 tablet_service.cc:1467] Processing CreateTablet for tablet cd4d505e013a44c986603c1c849de6b9 (DEFAULT_TABLE table=test-table [id=20f8f7bb95944cf6a7ef21ac7cf25951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:56.519100 28536 tablet_service.cc:1467] Processing CreateTablet for tablet cd4d505e013a44c986603c1c849de6b9 (DEFAULT_TABLE table=test-table [id=20f8f7bb95944cf6a7ef21ac7cf25951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:56.519750 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd4d505e013a44c986603c1c849de6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:56.520099 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd4d505e013a44c986603c1c849de6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:56.521826 28392 tablet_service.cc:1467] Processing CreateTablet for tablet cd4d505e013a44c986603c1c849de6b9 (DEFAULT_TABLE table=test-table [id=20f8f7bb95944cf6a7ef21ac7cf25951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:56.522794 28392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd4d505e013a44c986603c1c849de6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:56.525897 28629 tablet_bootstrap.cc:492] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: Bootstrap starting.
I20260808 08:29:56.528013 28630 tablet_bootstrap.cc:492] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: Bootstrap starting.
I20260808 08:29:56.528525 28629 tablet_bootstrap.cc:654] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:56.529456 28629 log.cc:824] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:56.530210 28630 tablet_bootstrap.cc:654] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:56.530783 28632 tablet_bootstrap.cc:492] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: Bootstrap starting.
I20260808 08:29:56.531060 28630 log.cc:824] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:56.531769 28629 tablet_bootstrap.cc:492] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: No bootstrap required, opened a new log
I20260808 08:29:56.532069 28629 ts_tablet_manager.cc:1397] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:29:56.533087 28632 tablet_bootstrap.cc:654] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:56.533631 28630 tablet_bootstrap.cc:492] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: No bootstrap required, opened a new log
I20260808 08:29:56.533844 28630 ts_tablet_manager.cc:1397] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:29:56.533915 28632 log.cc:824] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: Log is configured to *not* fsync() on all Append() calls
I20260808 08:29:56.535494 28629 raft_consensus.cc:348] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.535729 28629 raft_consensus.cc:374] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:56.535853 28629 raft_consensus.cc:729] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bbae82cedcc45eebbe69b574c6d969b, State: Initialized, Role: FOLLOWER
I20260808 08:29:56.535930 28632 tablet_bootstrap.cc:492] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: No bootstrap required, opened a new log
I20260808 08:29:56.536104 28632 ts_tablet_manager.cc:1397] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 08:29:56.536357 28629 consensus_queue.cc:260] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.537379 28629 ts_tablet_manager.cc:1428] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 08:29:56.537819 28315 heartbeater.cc:503] Master 127.25.170.62:36335 was elected leader, sending a full tablet report...
I20260808 08:29:56.537937 28630 raft_consensus.cc:348] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.538194 28630 raft_consensus.cc:374] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:56.538296 28630 raft_consensus.cc:729] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173328857f834b2d9b43280c60b50daf, State: Initialized, Role: FOLLOWER
I20260808 08:29:56.538738 28630 consensus_queue.cc:260] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.539422 28605 heartbeater.cc:503] Master 127.25.170.62:36335 was elected leader, sending a full tablet report...
I20260808 08:29:56.539681 28630 ts_tablet_manager.cc:1428] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:29:56.539987 28632 raft_consensus.cc:348] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.540234 28632 raft_consensus.cc:374] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:56.540294 28632 raft_consensus.cc:729] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98cb75ef2647456b9c79133a74a5d142, State: Initialized, Role: FOLLOWER
I20260808 08:29:56.540681 28632 consensus_queue.cc:260] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.541379 28460 heartbeater.cc:503] Master 127.25.170.62:36335 was elected leader, sending a full tablet report...
I20260808 08:29:56.541684 28632 ts_tablet_manager.cc:1428] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260808 08:29:56.704008 28606 tablet.cc:2369] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:29:56.734757 28461 tablet.cc:2369] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:29:56.758558 28636 raft_consensus.cc:482] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:29:56.758797 28636 raft_consensus.cc:504] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.760059 28636 leader_election.cc:288] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481), 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2:43777)
I20260808 08:29:56.764370 28625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.760381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:56953 (local address 127.25.170.1:45481)
0808 08:29:56.760523 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.760528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.760543 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:29:56.760670 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.760674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.760719 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.760809 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:56.761161 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.761757 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.763150 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.763770 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.763927 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.763988 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.764175 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.764248 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:29:56.764371 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.760253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45481 (local address 127.25.170.3:56953)
0808 08:29:56.760444 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.760461 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.760555 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.760855 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.760858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.760916 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:56.761051 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.761056 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.761868 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.761870 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.762991 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.763003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.763918 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.763922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.764036 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.764055 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.764146 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.764227 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"spinlock_wait_cycles":76416}
I20260808 08:29:56.764940 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.760440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:40075 (local address 127.25.170.2:43777)
0808 08:29:56.760567 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.760572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.760874 (+ 302us) server_negotiation.cc:407] Connection header received
0808 08:29:56.761014 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.761017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.761057 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.761144 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:56.761741 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.762397 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.763815 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.764349 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.764494 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.764543 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.764757 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.764833 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:29:56.764945 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.760319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:43777 (local address 127.25.170.3:40075)
0808 08:29:56.760735 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.760746 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.760902 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.761159 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.761163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.761188 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:56.761619 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.761625 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.762556 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.762559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.763667 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.763677 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.764494 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.764498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.764606 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.764635 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.764719 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.764791 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"spinlock_wait_cycles":1408,"thread_start_us":125,"threads_started":1}
W20260808 08:29:56.765065 28316 tablet.cc:2369] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:29:56.765121 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd4d505e013a44c986603c1c849de6b9" candidate_uuid: "173328857f834b2d9b43280c60b50daf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bbae82cedcc45eebbe69b574c6d969b" is_pre_election: true
I20260808 08:29:56.765435 28266 raft_consensus.cc:2454] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173328857f834b2d9b43280c60b50daf in term 0.
I20260808 08:29:56.765884 28413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd4d505e013a44c986603c1c849de6b9" candidate_uuid: "173328857f834b2d9b43280c60b50daf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98cb75ef2647456b9c79133a74a5d142" is_pre_election: true
I20260808 08:29:56.765962 28486 leader_election.cc:302] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173328857f834b2d9b43280c60b50daf, 4bbae82cedcc45eebbe69b574c6d969b; no voters:
I20260808 08:29:56.766170 28413 raft_consensus.cc:2454] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 173328857f834b2d9b43280c60b50daf in term 0.
I20260808 08:29:56.766279 28636 raft_consensus.cc:2781] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:29:56.766383 28636 raft_consensus.cc:482] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:29:56.766445 28636 raft_consensus.cc:3037] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:56.767553 28636 raft_consensus.cc:504] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.767962 28636 leader_election.cc:288] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [CANDIDATE]: Term 1 election: Requested vote from peers 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481), 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2:43777)
I20260808 08:29:56.768324 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd4d505e013a44c986603c1c849de6b9" candidate_uuid: "173328857f834b2d9b43280c60b50daf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bbae82cedcc45eebbe69b574c6d969b"
I20260808 08:29:56.768296 28413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd4d505e013a44c986603c1c849de6b9" candidate_uuid: "173328857f834b2d9b43280c60b50daf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98cb75ef2647456b9c79133a74a5d142"
I20260808 08:29:56.768450 28413 raft_consensus.cc:3037] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:56.768450 28266 raft_consensus.cc:3037] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:56.769745 28266 raft_consensus.cc:2454] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173328857f834b2d9b43280c60b50daf in term 1.
I20260808 08:29:56.769745 28413 raft_consensus.cc:2454] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 173328857f834b2d9b43280c60b50daf in term 1.
I20260808 08:29:56.770124 28488 leader_election.cc:302] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 173328857f834b2d9b43280c60b50daf, 4bbae82cedcc45eebbe69b574c6d969b, 98cb75ef2647456b9c79133a74a5d142; no voters:
I20260808 08:29:56.770370 28636 raft_consensus.cc:2781] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:56.770552 28636 raft_consensus.cc:686] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 1 LEADER]: Becoming Leader. State: Replica: 173328857f834b2d9b43280c60b50daf, State: Running, Role: LEADER
I20260808 08:29:56.770838 28636 consensus_queue.cc:237] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.774121 28098 catalog_manager.cc:5495] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf reported cstate change: term changed from 0 to 1, leader changed from <none> to 173328857f834b2d9b43280c60b50daf (127.25.170.3). New cstate: current_term: 1 leader_uuid: "173328857f834b2d9b43280c60b50daf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } health_report { overall_health: HEALTHY } } }
Aug 08 08:29:56 dist-test-slave-zkpd krb5kdc[28050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177795, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:56.846187 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.837716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:36335 (local address 127.0.0.1:53126)
0808 08:29:56.838036 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.838050 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.838178 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.838431 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.838434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.838856 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:29:56.838967 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.838973 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.839725 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.839729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.840320 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.840328 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.840787 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.840790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.840880 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.841451 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:29:56.841464 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:29:56.842962 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:29:56.844634 (+ 1672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.844645 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.844652 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.844873 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.845132 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:29:56.845136 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:29:56.845138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:29:56.845234 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:29:56.845599 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:29:56.845607 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:29:56.845716 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.845831 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.845986 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":102,"threads_started":1}
I20260808 08:29:56.846187 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.837792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53126 (local address 127.25.170.62:36335)
0808 08:29:56.837954 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.837958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.838123 (+ 165us) server_negotiation.cc:407] Connection header received
0808 08:29:56.838280 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.838284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.838326 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.838410 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:56.839091 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.839607 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.840439 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.840678 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.840788 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.843116 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:56.843124 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:56.843126 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:56.843147 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:56.844530 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.844967 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.844972 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.844974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.845046 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:56.845328 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:56.845331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:56.845333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:56.845498 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:56.845599 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.845878 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.846041 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":49}
I20260808 08:29:56.849936 28098 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:53126:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:29:56.850649 28098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:29:56.855732 28246 tablet_service.cc:1467] Processing CreateTablet for tablet 66b22fec3d894c069015cc8d74485d83 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=13a9b2d0065e4886a918cc85ccc6e383]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:29:56.855990 28536 tablet_service.cc:1467] Processing CreateTablet for tablet 66b22fec3d894c069015cc8d74485d83 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=13a9b2d0065e4886a918cc85ccc6e383]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:29:56.855860 28392 tablet_service.cc:1467] Processing CreateTablet for tablet 66b22fec3d894c069015cc8d74485d83 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=13a9b2d0065e4886a918cc85ccc6e383]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:29:56.856570 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66b22fec3d894c069015cc8d74485d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:56.856570 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66b22fec3d894c069015cc8d74485d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:56.856655 28392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66b22fec3d894c069015cc8d74485d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:56.859426 28632 tablet_bootstrap.cc:492] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: Bootstrap starting.
I20260808 08:29:56.859426 28629 tablet_bootstrap.cc:492] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: Bootstrap starting.
I20260808 08:29:56.860424 28629 tablet_bootstrap.cc:654] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:56.860423 28632 tablet_bootstrap.cc:654] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:56.861305 28630 tablet_bootstrap.cc:492] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: Bootstrap starting.
I20260808 08:29:56.861642 28632 tablet_bootstrap.cc:492] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: No bootstrap required, opened a new log
I20260808 08:29:56.861642 28629 tablet_bootstrap.cc:492] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: No bootstrap required, opened a new log
I20260808 08:29:56.861734 28632 ts_tablet_manager.cc:1397] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 08:29:56.861733 28629 ts_tablet_manager.cc:1397] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 08:29:56.862248 28630 tablet_bootstrap.cc:654] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:56.862198 28632 raft_consensus.cc:348] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.862198 28629 raft_consensus.cc:348] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.862316 28632 raft_consensus.cc:374] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:56.862324 28629 raft_consensus.cc:374] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:56.862363 28629 raft_consensus.cc:729] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bbae82cedcc45eebbe69b574c6d969b, State: Initialized, Role: FOLLOWER
I20260808 08:29:56.862363 28632 raft_consensus.cc:729] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98cb75ef2647456b9c79133a74a5d142, State: Initialized, Role: FOLLOWER
I20260808 08:29:56.862488 28629 consensus_queue.cc:260] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.862488 28632 consensus_queue.cc:260] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.862751 28629 ts_tablet_manager.cc:1428] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 08:29:56.862751 28632 ts_tablet_manager.cc:1428] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 08:29:56.862983 28637 tablet_replica.cc:439] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } } }
I20260808 08:29:56.863044 28635 tablet_replica.cc:439] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } } }
I20260808 08:29:56.863157 28637 tablet_replica.cc:442] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:56.863171 28635 tablet_replica.cc:442] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:56.863714 28630 tablet_bootstrap.cc:492] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: No bootstrap required, opened a new log
I20260808 08:29:56.863816 28630 ts_tablet_manager.cc:1397] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 08:29:56.864334 28630 raft_consensus.cc:348] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.864444 28630 raft_consensus.cc:374] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:56.864478 28630 raft_consensus.cc:729] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173328857f834b2d9b43280c60b50daf, State: Initialized, Role: FOLLOWER
I20260808 08:29:56.864624 28630 consensus_queue.cc:260] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.865180 28630 ts_tablet_manager.cc:1428] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:29:56.865160 28636 tablet_replica.cc:439] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } } }
I20260808 08:29:56.865353 28636 tablet_replica.cc:442] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:56.867955 28637 raft_consensus.cc:482] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:29:56.868052 28637 raft_consensus.cc:504] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.869140 28637 leader_election.cc:288] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481), 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771)
I20260808 08:29:56.873266 28625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.869380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:43505 (local address 127.25.170.1:45481)
0808 08:29:56.869494 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.869499 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.869737 (+ 238us) server_negotiation.cc:407] Connection header received
0808 08:29:56.869818 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.869820 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.869858 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.869964 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:56.870270 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.870802 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.872075 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.872655 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.872770 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.872831 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.873080 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.873169 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 08:29:56.873261 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.869338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45481 (local address 127.25.170.2:43505)
0808 08:29:56.869587 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.869599 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.869720 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.869978 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.869981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.869999 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:56.870131 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.870137 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.870919 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.870923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.871860 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.871871 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.872795 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.872799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.872921 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.872949 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.873032 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.873100 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"spinlock_wait_cycles":2432,"thread_start_us":80,"threads_started":1}
I20260808 08:29:56.874070 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.869604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:37763 (local address 127.25.170.3:38771)
0808 08:29:56.869728 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.869732 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.869981 (+ 249us) server_negotiation.cc:407] Connection header received
0808 08:29:56.870117 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.870120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.870158 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.870247 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:56.870851 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.871333 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.872760 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.873459 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.873563 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.873597 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.873874 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.873960 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:29:56.874070 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66b22fec3d894c069015cc8d74485d83" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bbae82cedcc45eebbe69b574c6d969b" is_pre_election: true
I20260808 08:29:56.874192 28266 raft_consensus.cc:2454] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 0.
I20260808 08:29:56.874449 28652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.869342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:38771 (local address 127.25.170.2:37763)
0808 08:29:56.869904 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.869913 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.870022 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.870259 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.870262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.870278 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:56.870730 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.870737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.871447 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.871451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.872625 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.872637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.873571 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.873575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.873677 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.873716 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.874199 (+ 483us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.874275 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"mutex_wait_us":24,"spinlock_wait_cycles":896,"thread_start_us":52,"threads_started":1}
I20260808 08:29:56.874694 28341 leader_election.cc:302] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bbae82cedcc45eebbe69b574c6d969b, 98cb75ef2647456b9c79133a74a5d142; no voters:
I20260808 08:29:56.875033 28637 raft_consensus.cc:2781] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:29:56.875142 28637 raft_consensus.cc:482] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:29:56.875192 28637 raft_consensus.cc:3037] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:56.875412 28559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66b22fec3d894c069015cc8d74485d83" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173328857f834b2d9b43280c60b50daf" is_pre_election: true
I20260808 08:29:56.875602 28559 raft_consensus.cc:2454] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 0.
I20260808 08:29:56.876430 28637 raft_consensus.cc:504] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.876796 28637 leader_election.cc:288] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 election: Requested vote from peers 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481), 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771)
I20260808 08:29:56.877254 28559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66b22fec3d894c069015cc8d74485d83" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173328857f834b2d9b43280c60b50daf"
I20260808 08:29:56.877254 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66b22fec3d894c069015cc8d74485d83" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bbae82cedcc45eebbe69b574c6d969b"
I20260808 08:29:56.877372 28559 raft_consensus.cc:3037] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:56.877372 28266 raft_consensus.cc:3037] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:56.878448 28266 raft_consensus.cc:2454] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 1.
I20260808 08:29:56.878448 28559 raft_consensus.cc:2454] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 1.
I20260808 08:29:56.878710 28341 leader_election.cc:302] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bbae82cedcc45eebbe69b574c6d969b, 98cb75ef2647456b9c79133a74a5d142; no voters:
I20260808 08:29:56.878876 28637 raft_consensus.cc:2781] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:56.879065 28637 raft_consensus.cc:686] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [term 1 LEADER]: Becoming Leader. State: Replica: 98cb75ef2647456b9c79133a74a5d142, State: Running, Role: LEADER
I20260808 08:29:56.879421 28637 consensus_queue.cc:237] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:56.881755 28653 tablet_replica.cc:439] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: TxnStatusTablet state changed. Reason: New leader 98cb75ef2647456b9c79133a74a5d142. Latest consensus state: current_term: 1 leader_uuid: "98cb75ef2647456b9c79133a74a5d142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } } }
I20260808 08:29:56.881875 28653 tablet_replica.cc:442] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:29:56.882182 28655 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:29:56.882400 28655 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:29:56.882913 28098 catalog_manager.cc:5495] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2). New cstate: current_term: 1 leader_uuid: "98cb75ef2647456b9c79133a74a5d142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260808 08:29:56.899859 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.895972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52666 (local address 127.25.170.2:43777)
0808 08:29:56.896105 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.896108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.896138 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:29:56.896303 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.896306 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.896383 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.896461 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:56.896734 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.897242 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.898458 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.898673 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.898762 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.899084 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:56.899484 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:56.899572 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.899679 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.899727 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:29:56.899924 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.895786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:43777 (local address 127.0.0.1:52666)
0808 08:29:56.896074 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.896089 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.896179 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.896500 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.896504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.896512 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:29:56.896624 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.896630 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.897351 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.897354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.898330 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.898341 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.898783 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.898787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.898890 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.898944 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:29:56.899578 (+ 634us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:29:56.899592 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.899669 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.899752 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184}
I20260808 08:29:56.904700 28559 raft_consensus.cc:1261] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Refusing update from remote peer 98cb75ef2647456b9c79133a74a5d142: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:56.904770 28266 raft_consensus.cc:1261] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Refusing update from remote peer 98cb75ef2647456b9c79133a74a5d142: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:56.905447 28653 consensus_queue.cc:1035] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:56.905627 28637 consensus_queue.cc:1035] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:56.909457 28635 tablet_replica.cc:439] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: TxnStatusTablet state changed. Reason: New leader 98cb75ef2647456b9c79133a74a5d142. Latest consensus state: current_term: 1 leader_uuid: "98cb75ef2647456b9c79133a74a5d142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } } }
I20260808 08:29:56.909584 28635 tablet_replica.cc:442] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:56.910506 28636 tablet_replica.cc:439] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: TxnStatusTablet state changed. Reason: New leader 98cb75ef2647456b9c79133a74a5d142. Latest consensus state: current_term: 1 leader_uuid: "98cb75ef2647456b9c79133a74a5d142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } } }
I20260808 08:29:56.910624 28636 tablet_replica.cc:442] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:56.911779 28637 tablet_replica.cc:439] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "98cb75ef2647456b9c79133a74a5d142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } } }
I20260808 08:29:56.911916 28637 tablet_replica.cc:442] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:29:56.912053 28637 tablet_replica.cc:439] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "98cb75ef2647456b9c79133a74a5d142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } } }
I20260808 08:29:56.912142 28637 tablet_replica.cc:442] T 66b22fec3d894c069015cc8d74485d83 P 98cb75ef2647456b9c79133a74a5d142: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:29:56.912490 28659 mvcc.cc:205] Tried to move back new op lower bound from 7316184256115253248 to 7316184256021020672. Current Snapshot: MvccSnapshot[applied={T|T < 7316184256115253248}]
I20260808 08:29:56.913738 28635 tablet_replica.cc:439] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "98cb75ef2647456b9c79133a74a5d142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } } }
I20260808 08:29:56.913846 28635 tablet_replica.cc:442] T 66b22fec3d894c069015cc8d74485d83 P 4bbae82cedcc45eebbe69b574c6d969b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:56.913966 28636 tablet_replica.cc:439] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "98cb75ef2647456b9c79133a74a5d142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } } }
I20260808 08:29:56.914063 28636 tablet_replica.cc:442] T 66b22fec3d894c069015cc8d74485d83 P 173328857f834b2d9b43280c60b50daf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:29:56.916852 28660 mvcc.cc:205] Tried to move back new op lower bound from 7316184256115253248 to 7316184256021020672. Current Snapshot: MvccSnapshot[applied={T|T < 7316184256115253248}]
I20260808 08:29:56.918838 28661 mvcc.cc:205] Tried to move back new op lower bound from 7316184256115253248 to 7316184256021020672. Current Snapshot: MvccSnapshot[applied={T|T < 7316184256115253248}]
I20260808 08:29:56.924422 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.920571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46162 (local address 127.25.170.3:38771)
0808 08:29:56.920682 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.920688 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.920723 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:29:56.920949 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.920952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.921013 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.921119 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:56.921388 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.921996 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.922958 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.923191 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.923328 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.923611 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:56.924049 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:56.924169 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.924236 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.924295 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:29:56.934536 28611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.931268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:43777 (local address 127.25.170.3:50133)
0808 08:29:56.931417 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.931441 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.931510 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.931747 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.931750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.931758 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:29:56.931876 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.931881 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.932710 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.932715 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.933307 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.933315 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.933780 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.933784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.933884 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.933932 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:29:56.934276 (+ 344us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:29:56.934283 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.934345 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.934424 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 08:29:56.934536 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.931366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:50133 (local address 127.25.170.2:43777)
0808 08:29:56.931478 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.931484 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.931502 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:29:56.931593 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.931596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.931636 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.931729 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:56.932014 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.932595 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.933437 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.933659 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.933785 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.934102 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:56.934170 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:56.934249 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.934355 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.934406 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 08:29:56.941720 28266 raft_consensus.cc:1261] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Refusing update from remote peer 173328857f834b2d9b43280c60b50daf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:56.941784 28413 raft_consensus.cc:1261] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Refusing update from remote peer 173328857f834b2d9b43280c60b50daf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:56.942391 28639 consensus_queue.cc:1035] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:56.942642 28636 consensus_queue.cc:1035] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [LEADER]: Connected to new peer: Peer: permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:56.966403 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.962381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:42337 (local address 127.25.170.3:38771)
0808 08:29:56.962520 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:56.962526 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:56.962742 (+ 216us) server_negotiation.cc:407] Connection header received
0808 08:29:56.962868 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:56.962872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:56.962932 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:56.962997 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:56.963301 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.964080 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.965348 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.965568 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.965646 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.965994 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:56.966062 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:56.966118 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:56.966243 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 08:29:56.966294 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:29:56.966471 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:56.962297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:38771 (local address 127.25.170.2:42337)
0808 08:29:56.962634 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:56.962650 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:56.962768 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:56.963043 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:56.963046 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:56.963055 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:29:56.963213 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.963219 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.964185 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.964189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.965212 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:56.965225 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:56.965681 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:56.965684 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:56.965785 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:56.965858 (+ 73us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:29:56.966150 (+ 292us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:29:56.966157 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:29:56.966224 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 08:29:56.966306 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":126,"threads_started":1}
I20260808 08:29:56.993681 28098 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:29:56.993902 28098 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:29:56.996656 28098 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f: Sending DeleteTablet for 3 replicas of tablet cd4d505e013a44c986603c1c849de6b9
I20260808 08:29:56.997430 28246 tablet_service.cc:1514] Processing DeleteTablet for tablet cd4d505e013a44c986603c1c849de6b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:56 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:47616
I20260808 08:29:56.997515 28536 tablet_service.cc:1514] Processing DeleteTablet for tablet cd4d505e013a44c986603c1c849de6b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:56 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:46146
I20260808 08:29:56.998003 28680 tablet_replica.cc:330] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: stopping tablet replica
I20260808 08:29:56.998534 28680 raft_consensus.cc:2229] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:29:56.999056 28098 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 08:29:56.999166 28392 tablet_service.cc:1514] Processing DeleteTablet for tablet cd4d505e013a44c986603c1c849de6b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:56 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:52652
W20260808 08:29:56.999476 28098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:29:56.999934 28679 tablet_replica.cc:330] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: stopping tablet replica
I20260808 08:29:57.000326 28679 raft_consensus.cc:2229] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:29:57.000625 28679 raft_consensus.cc:2258] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:57.001066 28680 raft_consensus.cc:2258] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:57.001477 28681 tablet_replica.cc:330] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: stopping tablet replica
I20260808 08:29:57.001772 28681 raft_consensus.cc:2229] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:29:57.001946 28681 raft_consensus.cc:2258] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:57.002586 28680 ts_tablet_manager.cc:1905] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:57.003458 28679 ts_tablet_manager.cc:1905] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:57.004510 28246 tablet_service.cc:1467] Processing CreateTablet for tablet 905902470efb44419ce64ec0c833ace1 (DEFAULT_TABLE table=test-table [id=62afcb9de2f641c7a1810b23ab15a770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:57.004756 28536 tablet_service.cc:1467] Processing CreateTablet for tablet 905902470efb44419ce64ec0c833ace1 (DEFAULT_TABLE table=test-table [id=62afcb9de2f641c7a1810b23ab15a770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:57.004817 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 905902470efb44419ce64ec0c833ace1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:57.005010 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 905902470efb44419ce64ec0c833ace1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:57.005040 28392 tablet_service.cc:1467] Processing CreateTablet for tablet 905902470efb44419ce64ec0c833ace1 (DEFAULT_TABLE table=test-table [id=62afcb9de2f641c7a1810b23ab15a770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:57.005314 28392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 905902470efb44419ce64ec0c833ace1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:57.005856 28680 ts_tablet_manager.cc:1918] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:29:57.005956 28680 log.cc:1196] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/cd4d505e013a44c986603c1c849de6b9
I20260808 08:29:57.006289 28680 ts_tablet_manager.cc:1939] T cd4d505e013a44c986603c1c849de6b9 P 173328857f834b2d9b43280c60b50daf: Deleting consensus metadata
I20260808 08:29:57.007544 28630 tablet_bootstrap.cc:492] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf: Bootstrap starting.
I20260808 08:29:57.007573 28081 catalog_manager.cc:4841] TS 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771): tablet cd4d505e013a44c986603c1c849de6b9 (table test-table [id=20f8f7bb95944cf6a7ef21ac7cf25951]) successfully deleted
I20260808 08:29:57.007928 28632 tablet_bootstrap.cc:492] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142: Bootstrap starting.
I20260808 08:29:57.008512 28630 tablet_bootstrap.cc:654] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:57.008721 28632 tablet_bootstrap.cc:654] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:57.008829 28681 ts_tablet_manager.cc:1905] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:57.009182 28629 tablet_bootstrap.cc:492] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b: Bootstrap starting.
I20260808 08:29:57.010182 28629 tablet_bootstrap.cc:654] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:57.014163 28679 ts_tablet_manager.cc:1918] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:29:57.014540 28679 log.cc:1196] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/cd4d505e013a44c986603c1c849de6b9
I20260808 08:29:57.015522 28630 tablet_bootstrap.cc:492] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf: No bootstrap required, opened a new log
I20260808 08:29:57.015609 28630 ts_tablet_manager.cc:1397] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260808 08:29:57.016155 28630 raft_consensus.cc:348] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:57.016283 28630 raft_consensus.cc:374] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:57.016317 28630 raft_consensus.cc:729] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173328857f834b2d9b43280c60b50daf, State: Initialized, Role: FOLLOWER
I20260808 08:29:57.016443 28630 consensus_queue.cc:260] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:57.016767 28630 ts_tablet_manager.cc:1428] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:29:57.017163 28632 tablet_bootstrap.cc:492] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142: No bootstrap required, opened a new log
I20260808 08:29:57.017242 28632 ts_tablet_manager.cc:1397] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260808 08:29:57.017757 28632 raft_consensus.cc:348] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:57.017880 28632 raft_consensus.cc:374] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:57.017915 28632 raft_consensus.cc:729] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98cb75ef2647456b9c79133a74a5d142, State: Initialized, Role: FOLLOWER
I20260808 08:29:57.018034 28632 consensus_queue.cc:260] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:57.018307 28632 ts_tablet_manager.cc:1428] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:29:57.015066 28629 tablet_bootstrap.cc:492] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b: No bootstrap required, opened a new log
I20260808 08:29:57.019068 28629 ts_tablet_manager.cc:1397] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260808 08:29:57.019559 28629 raft_consensus.cc:348] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:57.019678 28629 raft_consensus.cc:374] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:57.019718 28629 raft_consensus.cc:729] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bbae82cedcc45eebbe69b574c6d969b, State: Initialized, Role: FOLLOWER
I20260808 08:29:57.019850 28629 consensus_queue.cc:260] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:57.020140 28629 ts_tablet_manager.cc:1428] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:29:57.021320 28637 raft_consensus.cc:482] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:29:57.021413 28637 raft_consensus.cc:504] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:57.021832 28637 leader_election.cc:288] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481), 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771)
I20260808 08:29:57.022403 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "905902470efb44419ce64ec0c833ace1" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bbae82cedcc45eebbe69b574c6d969b" is_pre_election: true
I20260808 08:29:57.022534 28266 raft_consensus.cc:2454] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 0.
I20260808 08:29:57.022712 28679 ts_tablet_manager.cc:1939] T cd4d505e013a44c986603c1c849de6b9 P 4bbae82cedcc45eebbe69b574c6d969b: Deleting consensus metadata
I20260808 08:29:57.022781 28559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "905902470efb44419ce64ec0c833ace1" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173328857f834b2d9b43280c60b50daf" is_pre_election: true
I20260808 08:29:57.022921 28559 raft_consensus.cc:2454] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 0.
I20260808 08:29:57.023375 28341 leader_election.cc:302] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bbae82cedcc45eebbe69b574c6d969b, 98cb75ef2647456b9c79133a74a5d142; no voters:
I20260808 08:29:57.023547 28637 raft_consensus.cc:2781] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:29:57.023602 28637 raft_consensus.cc:482] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:29:57.023644 28637 raft_consensus.cc:3037] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:57.024405 28080 catalog_manager.cc:4841] TS 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481): tablet cd4d505e013a44c986603c1c849de6b9 (table test-table [id=20f8f7bb95944cf6a7ef21ac7cf25951]) successfully deleted
I20260808 08:29:57.024793 28637 raft_consensus.cc:504] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:57.025144 28637 leader_election.cc:288] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 election: Requested vote from peers 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481), 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771)
I20260808 08:29:57.026286 28559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "905902470efb44419ce64ec0c833ace1" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173328857f834b2d9b43280c60b50daf"
I20260808 08:29:57.026412 28559 raft_consensus.cc:3037] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:57.027581 28559 raft_consensus.cc:2454] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 1.
I20260808 08:29:57.027832 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "905902470efb44419ce64ec0c833ace1" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bbae82cedcc45eebbe69b574c6d969b"
I20260808 08:29:57.027974 28266 raft_consensus.cc:3037] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:57.029088 28266 raft_consensus.cc:2454] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 1.
I20260808 08:29:57.029359 28342 leader_election.cc:302] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173328857f834b2d9b43280c60b50daf, 98cb75ef2647456b9c79133a74a5d142; no voters:
I20260808 08:29:57.029584 28681 ts_tablet_manager.cc:1918] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:29:57.029724 28681 log.cc:1196] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/cd4d505e013a44c986603c1c849de6b9
I20260808 08:29:57.029798 28637 raft_consensus.cc:2781] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:57.029927 28637 raft_consensus.cc:686] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 1 LEADER]: Becoming Leader. State: Replica: 98cb75ef2647456b9c79133a74a5d142, State: Running, Role: LEADER
I20260808 08:29:57.030050 28637 consensus_queue.cc:237] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:57.031111 28681 ts_tablet_manager.cc:1939] T cd4d505e013a44c986603c1c849de6b9 P 98cb75ef2647456b9c79133a74a5d142: Deleting consensus metadata
I20260808 08:29:57.031687 28099 catalog_manager.cc:5495] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2). New cstate: current_term: 1 leader_uuid: "98cb75ef2647456b9c79133a74a5d142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260808 08:29:57.036545 28082 catalog_manager.cc:4841] TS 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2:43777): tablet cd4d505e013a44c986603c1c849de6b9 (table test-table [id=20f8f7bb95944cf6a7ef21ac7cf25951]) successfully deleted
I20260808 08:29:57.053117 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:57.048792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52680 (local address 127.25.170.2:43777)
0808 08:29:57.048914 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:57.048919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:57.048934 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:29:57.049069 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:57.049072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:57.049128 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:57.049208 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:57.049603 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:57.050399 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:57.051598 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:57.051942 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:57.052040 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:57.052413 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:57.052501 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:57.052570 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:57.052927 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 08:29:57.052982 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:29:57.062824 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:57.059226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:43777 (local address 127.25.170.2:42701)
0808 08:29:57.059413 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:57.059427 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:57.059497 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:57.059800 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:57.059812 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:57.059818 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:29:57.059879 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:57.059883 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:57.060793 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:57.060796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:57.061649 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:57.061660 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:57.062229 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:57.062231 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:57.062299 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:57.062322 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:29:57.062562 (+ 240us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:29:57.062565 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 08:29:57.062611 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 08:29:57.062682 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260808 08:29:57.063205 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:57.059304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:42701 (local address 127.25.170.2:43777)
0808 08:29:57.059604 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:57.059608 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:57.059617 (+ 9us) server_negotiation.cc:407] Connection header received
0808 08:29:57.059646 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:57.059648 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:57.059681 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:57.059731 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:57.059992 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:57.060673 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:57.061767 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:57.062087 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:57.062169 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:57.062417 (+ 248us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:57.062487 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:57.062538 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:57.063060 (+ 522us) server_negotiation.cc:299] Negotiation successful
0808 08:29:57.063101 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253}
I20260808 08:29:57.070382 28266 raft_consensus.cc:1261] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Refusing update from remote peer 98cb75ef2647456b9c79133a74a5d142: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:57.070423 28559 raft_consensus.cc:1261] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Refusing update from remote peer 98cb75ef2647456b9c79133a74a5d142: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:57.070835 28637 consensus_queue.cc:1035] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:57.071324 28637 consensus_queue.cc:1035] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:29:57.089053 28659 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 08:29:58.646940 28098 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:29:58.647116 28098 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:29:58.649451 28098 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f: Sending DeleteTablet for 3 replicas of tablet 905902470efb44419ce64ec0c833ace1
I20260808 08:29:58.649997 28246 tablet_service.cc:1514] Processing DeleteTablet for tablet 905902470efb44419ce64ec0c833ace1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:58 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:47616
I20260808 08:29:58.649989 28391 tablet_service.cc:1514] Processing DeleteTablet for tablet 905902470efb44419ce64ec0c833ace1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:58 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:52652
I20260808 08:29:58.650064 28536 tablet_service.cc:1514] Processing DeleteTablet for tablet 905902470efb44419ce64ec0c833ace1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:58 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:46146
I20260808 08:29:58.650344 28710 tablet_replica.cc:330] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142: stopping tablet replica
I20260808 08:29:58.650467 28710 raft_consensus.cc:2229] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:29:58.650501 28712 tablet_replica.cc:330] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf: stopping tablet replica
I20260808 08:29:58.650717 28712 raft_consensus.cc:2229] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:29:58.650782 28710 raft_consensus.cc:2258] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:58.650813 28712 raft_consensus.cc:2258] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:58.651049 28711 tablet_replica.cc:330] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b: stopping tablet replica
I20260808 08:29:58.651181 28711 raft_consensus.cc:2229] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:29:58.651280 28711 raft_consensus.cc:2258] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:58.651471 28712 ts_tablet_manager.cc:1905] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:58.651865 28711 ts_tablet_manager.cc:1905] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:58.653226 28710 ts_tablet_manager.cc:1905] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:58.654451 28712 ts_tablet_manager.cc:1918] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:29:58.654541 28712 log.cc:1196] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/905902470efb44419ce64ec0c833ace1
I20260808 08:29:58.654824 28712 ts_tablet_manager.cc:1939] T 905902470efb44419ce64ec0c833ace1 P 173328857f834b2d9b43280c60b50daf: Deleting consensus metadata
I20260808 08:29:58.655591 28081 catalog_manager.cc:4841] TS 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771): tablet 905902470efb44419ce64ec0c833ace1 (table test-table [id=62afcb9de2f641c7a1810b23ab15a770]) successfully deleted
I20260808 08:29:58.656116 28710 ts_tablet_manager.cc:1918] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:29:58.656200 28710 log.cc:1196] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/905902470efb44419ce64ec0c833ace1
I20260808 08:29:58.656330 28711 ts_tablet_manager.cc:1918] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:29:58.656430 28711 log.cc:1196] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/905902470efb44419ce64ec0c833ace1
I20260808 08:29:58.656523 28710 ts_tablet_manager.cc:1939] T 905902470efb44419ce64ec0c833ace1 P 98cb75ef2647456b9c79133a74a5d142: Deleting consensus metadata
I20260808 08:29:58.656746 28711 ts_tablet_manager.cc:1939] T 905902470efb44419ce64ec0c833ace1 P 4bbae82cedcc45eebbe69b574c6d969b: Deleting consensus metadata
I20260808 08:29:58.657243 28082 catalog_manager.cc:4841] TS 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2:43777): tablet 905902470efb44419ce64ec0c833ace1 (table test-table [id=62afcb9de2f641c7a1810b23ab15a770]) successfully deleted
I20260808 08:29:58.657405 28080 catalog_manager.cc:4841] TS 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481): tablet 905902470efb44419ce64ec0c833ace1 (table test-table [id=62afcb9de2f641c7a1810b23ab15a770]) successfully deleted
Aug 08 08:29:58 dist-test-slave-zkpd krb5kdc[28050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177798, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:29:58 dist-test-slave-zkpd krb5kdc[28050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177798, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:29:58.684027 28720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:58.672386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53138 (local address 127.25.170.62:36335)
0808 08:29:58.672678 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:58.672689 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:58.672707 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:29:58.672919 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:58.672923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:58.672978 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:58.673077 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:29:58.673791 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.674351 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.675200 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.675438 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.675548 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:58.680888 (+ 5340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:29:58.680892 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:29:58.680894 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:29:58.680919 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:29:58.682235 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:58.682669 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:58.682673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:58.682675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:58.682762 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:29:58.683050 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:29:58.683053 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:29:58.683055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:29:58.683239 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:29:58.683407 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:58.683650 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 08:29:58.683779 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":98,"threads_started":1}
I20260808 08:29:58.686551 28098 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53138:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:29:58.686981 28098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:29:58.691658 28246 tablet_service.cc:1467] Processing CreateTablet for tablet 7d92d058b0a24b6bbb6254e89f705ab5 (DEFAULT_TABLE table=test-table [id=b6927e8e8461489bb3540b8499a477e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:58.691711 28391 tablet_service.cc:1467] Processing CreateTablet for tablet 7d92d058b0a24b6bbb6254e89f705ab5 (DEFAULT_TABLE table=test-table [id=b6927e8e8461489bb3540b8499a477e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:58.691854 28536 tablet_service.cc:1467] Processing CreateTablet for tablet 7d92d058b0a24b6bbb6254e89f705ab5 (DEFAULT_TABLE table=test-table [id=b6927e8e8461489bb3540b8499a477e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:58.692008 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d92d058b0a24b6bbb6254e89f705ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:58.692011 28391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d92d058b0a24b6bbb6254e89f705ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:58.692209 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d92d058b0a24b6bbb6254e89f705ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:58.694240 28721 tablet_bootstrap.cc:492] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf: Bootstrap starting.
I20260808 08:29:58.694759 28722 tablet_bootstrap.cc:492] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b: Bootstrap starting.
I20260808 08:29:58.695195 28723 tablet_bootstrap.cc:492] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142: Bootstrap starting.
I20260808 08:29:58.695246 28721 tablet_bootstrap.cc:654] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:58.695616 28722 tablet_bootstrap.cc:654] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:58.696192 28723 tablet_bootstrap.cc:654] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:58.696533 28721 tablet_bootstrap.cc:492] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf: No bootstrap required, opened a new log
I20260808 08:29:58.696641 28721 ts_tablet_manager.cc:1397] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:29:58.697113 28721 raft_consensus.cc:348] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.697232 28721 raft_consensus.cc:374] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:58.697240 28722 tablet_bootstrap.cc:492] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b: No bootstrap required, opened a new log
I20260808 08:29:58.697278 28721 raft_consensus.cc:729] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173328857f834b2d9b43280c60b50daf, State: Initialized, Role: FOLLOWER
I20260808 08:29:58.697324 28722 ts_tablet_manager.cc:1397] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 08:29:58.697422 28721 consensus_queue.cc:260] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.697849 28721 ts_tablet_manager.cc:1428] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 08:29:58.697798 28722 raft_consensus.cc:348] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.697924 28722 raft_consensus.cc:374] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:58.697963 28722 raft_consensus.cc:729] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bbae82cedcc45eebbe69b574c6d969b, State: Initialized, Role: FOLLOWER
I20260808 08:29:58.698096 28722 consensus_queue.cc:260] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.698503 28722 ts_tablet_manager.cc:1428] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:29:58.699044 28723 tablet_bootstrap.cc:492] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142: No bootstrap required, opened a new log
I20260808 08:29:58.699153 28723 ts_tablet_manager.cc:1397] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 08:29:58.699620 28723 raft_consensus.cc:348] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.699748 28723 raft_consensus.cc:374] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:58.699792 28723 raft_consensus.cc:729] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98cb75ef2647456b9c79133a74a5d142, State: Initialized, Role: FOLLOWER
I20260808 08:29:58.699970 28723 consensus_queue.cc:260] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.700249 28723 ts_tablet_manager.cc:1428] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:29:58.751431 28693 raft_consensus.cc:482] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:29:58.751587 28693 raft_consensus.cc:504] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.752161 28693 leader_election.cc:288] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481), 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771)
I20260808 08:29:58.752635 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d92d058b0a24b6bbb6254e89f705ab5" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bbae82cedcc45eebbe69b574c6d969b" is_pre_election: true
I20260808 08:29:58.752635 28559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d92d058b0a24b6bbb6254e89f705ab5" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173328857f834b2d9b43280c60b50daf" is_pre_election: true
I20260808 08:29:58.752808 28559 raft_consensus.cc:2454] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 0.
I20260808 08:29:58.752822 28266 raft_consensus.cc:2454] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 0.
I20260808 08:29:58.753149 28341 leader_election.cc:302] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bbae82cedcc45eebbe69b574c6d969b, 98cb75ef2647456b9c79133a74a5d142; no voters:
I20260808 08:29:58.753328 28693 raft_consensus.cc:2781] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:29:58.753394 28693 raft_consensus.cc:482] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:29:58.753422 28693 raft_consensus.cc:3037] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:58.754473 28693 raft_consensus.cc:504] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.754801 28693 leader_election.cc:288] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 election: Requested vote from peers 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481), 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771)
I20260808 08:29:58.755163 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d92d058b0a24b6bbb6254e89f705ab5" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bbae82cedcc45eebbe69b574c6d969b"
I20260808 08:29:58.755167 28559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d92d058b0a24b6bbb6254e89f705ab5" candidate_uuid: "98cb75ef2647456b9c79133a74a5d142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173328857f834b2d9b43280c60b50daf"
I20260808 08:29:58.755285 28559 raft_consensus.cc:3037] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:58.755306 28266 raft_consensus.cc:3037] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:58.756464 28266 raft_consensus.cc:2454] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 1.
I20260808 08:29:58.756464 28559 raft_consensus.cc:2454] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98cb75ef2647456b9c79133a74a5d142 in term 1.
I20260808 08:29:58.756747 28341 leader_election.cc:302] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bbae82cedcc45eebbe69b574c6d969b, 98cb75ef2647456b9c79133a74a5d142; no voters:
I20260808 08:29:58.756949 28693 raft_consensus.cc:2781] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:58.757056 28693 raft_consensus.cc:686] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 1 LEADER]: Becoming Leader. State: Replica: 98cb75ef2647456b9c79133a74a5d142, State: Running, Role: LEADER
I20260808 08:29:58.757202 28693 consensus_queue.cc:237] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.758842 28099 catalog_manager.cc:5495] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2). New cstate: current_term: 1 leader_uuid: "98cb75ef2647456b9c79133a74a5d142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260808 08:29:58.783325 28732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:58.780253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52696 (local address 127.25.170.2:43777)
0808 08:29:58.780548 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:58.780556 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:58.780568 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:29:58.780606 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:58.780609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:58.780648 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:58.780723 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:58.780948 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.781472 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.782298 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.782519 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.782599 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:58.782864 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:58.782933 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:58.782988 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:58.783071 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 08:29:58.783114 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":152,"threads_started":1}
I20260808 08:29:58.789314 28266 raft_consensus.cc:1261] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Refusing update from remote peer 98cb75ef2647456b9c79133a74a5d142: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:58.789644 28559 raft_consensus.cc:1261] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Refusing update from remote peer 98cb75ef2647456b9c79133a74a5d142: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:58.789733 28664 consensus_queue.cc:1035] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:58.790050 28664 consensus_queue.cc:1035] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:58.821116 28099 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:29:58.821271 28099 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:29:58.823218 28099 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f: Sending DeleteTablet for 3 replicas of tablet 7d92d058b0a24b6bbb6254e89f705ab5
I20260808 08:29:58.823866 28536 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d92d058b0a24b6bbb6254e89f705ab5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:58 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:46146
I20260808 08:29:58.823935 28391 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d92d058b0a24b6bbb6254e89f705ab5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:58 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:52652
I20260808 08:29:58.824095 28712 tablet_replica.cc:330] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf: stopping tablet replica
I20260808 08:29:58.824141 28710 tablet_replica.cc:330] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142: stopping tablet replica
I20260808 08:29:58.824251 28710 raft_consensus.cc:2229] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:29:58.824258 28712 raft_consensus.cc:2229] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:29:58.824358 28712 raft_consensus.cc:2258] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:58.824416 28710 raft_consensus.cc:2258] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:29:58.824977 28246 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d92d058b0a24b6bbb6254e89f705ab5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:29:58 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:47616
I20260808 08:29:58.825142 28711 tablet_replica.cc:330] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b: stopping tablet replica
I20260808 08:29:58.825109 28099 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53138:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 08:29:58.825240 28711 raft_consensus.cc:2229] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:29:58.825321 28712 ts_tablet_manager.cc:1905] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:58.825316 28710 ts_tablet_manager.cc:1905] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:58.825345 28711 raft_consensus.cc:2258] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 08:29:58.825480 28099 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:29:58.826171 28711 ts_tablet_manager.cc:1905] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:29:58.827859 28712 ts_tablet_manager.cc:1918] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:29:58.827960 28712 log.cc:1196] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/7d92d058b0a24b6bbb6254e89f705ab5
I20260808 08:29:58.827984 28710 ts_tablet_manager.cc:1918] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:29:58.828058 28710 log.cc:1196] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/7d92d058b0a24b6bbb6254e89f705ab5
I20260808 08:29:58.828266 28712 ts_tablet_manager.cc:1939] T 7d92d058b0a24b6bbb6254e89f705ab5 P 173328857f834b2d9b43280c60b50daf: Deleting consensus metadata
I20260808 08:29:58.828357 28710 ts_tablet_manager.cc:1939] T 7d92d058b0a24b6bbb6254e89f705ab5 P 98cb75ef2647456b9c79133a74a5d142: Deleting consensus metadata
I20260808 08:29:58.828428 28711 ts_tablet_manager.cc:1918] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:29:58.828502 28711 log.cc:1196] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/7d92d058b0a24b6bbb6254e89f705ab5
I20260808 08:29:58.828770 28711 ts_tablet_manager.cc:1939] T 7d92d058b0a24b6bbb6254e89f705ab5 P 4bbae82cedcc45eebbe69b574c6d969b: Deleting consensus metadata
I20260808 08:29:58.829059 28082 catalog_manager.cc:4841] TS 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2:43777): tablet 7d92d058b0a24b6bbb6254e89f705ab5 (table test-table [id=b6927e8e8461489bb3540b8499a477e7]) successfully deleted
I20260808 08:29:58.829442 28080 catalog_manager.cc:4841] TS 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481): tablet 7d92d058b0a24b6bbb6254e89f705ab5 (table test-table [id=b6927e8e8461489bb3540b8499a477e7]) successfully deleted
I20260808 08:29:58.829751 28081 catalog_manager.cc:4841] TS 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771): tablet 7d92d058b0a24b6bbb6254e89f705ab5 (table test-table [id=b6927e8e8461489bb3540b8499a477e7]) successfully deleted
I20260808 08:29:58.831252 28246 tablet_service.cc:1467] Processing CreateTablet for tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7 (DEFAULT_TABLE table=test-table [id=ad4ddaeef4f94ba7ace23aea4a995c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:58.831290 28391 tablet_service.cc:1467] Processing CreateTablet for tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7 (DEFAULT_TABLE table=test-table [id=ad4ddaeef4f94ba7ace23aea4a995c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:58.831502 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:58.831611 28391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:58.833274 28722 tablet_bootstrap.cc:492] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b: Bootstrap starting.
I20260808 08:29:58.833461 28723 tablet_bootstrap.cc:492] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142: Bootstrap starting.
I20260808 08:29:58.834074 28722 tablet_bootstrap.cc:654] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:58.834131 28723 tablet_bootstrap.cc:654] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:58.835018 28536 tablet_service.cc:1467] Processing CreateTablet for tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7 (DEFAULT_TABLE table=test-table [id=ad4ddaeef4f94ba7ace23aea4a995c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:29:58.835248 28722 tablet_bootstrap.cc:492] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b: No bootstrap required, opened a new log
I20260808 08:29:58.835265 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:29:58.835333 28722 ts_tablet_manager.cc:1397] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:29:58.835650 28722 raft_consensus.cc:348] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.835727 28722 raft_consensus.cc:374] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:58.835748 28722 raft_consensus.cc:729] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bbae82cedcc45eebbe69b574c6d969b, State: Initialized, Role: FOLLOWER
I20260808 08:29:58.835841 28722 consensus_queue.cc:260] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.836133 28722 ts_tablet_manager.cc:1428] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 08:29:58.837237 28721 tablet_bootstrap.cc:492] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf: Bootstrap starting.
I20260808 08:29:58.837667 28723 tablet_bootstrap.cc:492] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142: No bootstrap required, opened a new log
I20260808 08:29:58.837760 28723 ts_tablet_manager.cc:1397] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 08:29:58.838095 28721 tablet_bootstrap.cc:654] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf: Neither blocks nor log segments found. Creating new log.
I20260808 08:29:58.838129 28723 raft_consensus.cc:348] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.838279 28723 raft_consensus.cc:374] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:58.838342 28723 raft_consensus.cc:729] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98cb75ef2647456b9c79133a74a5d142, State: Initialized, Role: FOLLOWER
I20260808 08:29:58.838465 28723 consensus_queue.cc:260] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.838760 28723 ts_tablet_manager.cc:1428] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:29:58.839301 28721 tablet_bootstrap.cc:492] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf: No bootstrap required, opened a new log
I20260808 08:29:58.839394 28721 ts_tablet_manager.cc:1397] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:29:58.839792 28721 raft_consensus.cc:348] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.839933 28721 raft_consensus.cc:374] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:29:58.839993 28721 raft_consensus.cc:729] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173328857f834b2d9b43280c60b50daf, State: Initialized, Role: FOLLOWER
I20260808 08:29:58.840121 28721 consensus_queue.cc:260] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.840386 28721 ts_tablet_manager.cc:1428] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:29:58.936828 28729 raft_consensus.cc:482] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:29:58.936990 28729 raft_consensus.cc:504] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.938247 28729 leader_election.cc:288] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2:43777), 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771)
I20260808 08:29:58.942480 28732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:58.938875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:51793 (local address 127.25.170.2:43777)
0808 08:29:58.938989 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:58.938993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:58.939008 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:29:58.939171 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:58.939174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:58.939230 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:58.939315 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:58.939623 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.940242 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.941466 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.941878 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.942010 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:58.942069 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:58.942271 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 08:29:58.942346 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 08:29:58.942543 28739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:58.938525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:43777 (local address 127.25.170.1:51793)
0808 08:29:58.938862 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:58.938877 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:58.938993 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:58.939329 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:58.939332 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:58.939348 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:58.939504 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:58.939510 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.940362 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.940367 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:58.941330 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:58.941340 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.942007 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.942011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:58.942116 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:58.942159 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 08:29:58.942257 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 08:29:58.942331 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":48,"spinlock_wait_cycles":16896,"thread_start_us":105,"threads_started":1}
I20260808 08:29:58.942514 28741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:58.938610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:43899 (local address 127.25.170.3:38771)
0808 08:29:58.938941 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:58.938956 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:58.939019 (+ 63us) server_negotiation.cc:407] Connection header received
0808 08:29:58.939179 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:58.939182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:58.939236 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:58.939352 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:29:58.939678 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.940239 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.941461 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.941903 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.942037 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:58.942091 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:58.942299 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 08:29:58.942379 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":73,"threads_started":1}
I20260808 08:29:58.942544 28740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:58.938568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:38771 (local address 127.25.170.1:43899)
0808 08:29:58.938939 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:58.938956 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:58.939069 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:58.939366 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:58.939369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:58.939408 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:29:58.939562 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:58.939567 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.940390 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.940394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:58.941329 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:58.941338 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.942029 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.942032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:58.942164 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:58.942193 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 08:29:58.942282 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 08:29:58.942353 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":105,"spinlock_wait_cycles":768,"thread_start_us":77,"threads_started":1}
I20260808 08:29:58.942966 28413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bd716d9f1cd4f1aaf8e54e4273b80b7" candidate_uuid: "4bbae82cedcc45eebbe69b574c6d969b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98cb75ef2647456b9c79133a74a5d142" is_pre_election: true
I20260808 08:29:58.943130 28413 raft_consensus.cc:2454] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bbae82cedcc45eebbe69b574c6d969b in term 0.
I20260808 08:29:58.943111 28559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bd716d9f1cd4f1aaf8e54e4273b80b7" candidate_uuid: "4bbae82cedcc45eebbe69b574c6d969b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173328857f834b2d9b43280c60b50daf" is_pre_election: true
I20260808 08:29:58.943264 28559 raft_consensus.cc:2454] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bbae82cedcc45eebbe69b574c6d969b in term 0.
I20260808 08:29:58.943545 28196 leader_election.cc:302] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bbae82cedcc45eebbe69b574c6d969b, 98cb75ef2647456b9c79133a74a5d142; no voters:
I20260808 08:29:58.943782 28729 raft_consensus.cc:2781] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:29:58.943850 28729 raft_consensus.cc:482] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:29:58.943918 28729 raft_consensus.cc:3037] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:58.944921 28729 raft_consensus.cc:504] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.945248 28729 leader_election.cc:288] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [CANDIDATE]: Term 1 election: Requested vote from peers 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2:43777), 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771)
I20260808 08:29:58.945562 28413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bd716d9f1cd4f1aaf8e54e4273b80b7" candidate_uuid: "4bbae82cedcc45eebbe69b574c6d969b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98cb75ef2647456b9c79133a74a5d142"
I20260808 08:29:58.945688 28413 raft_consensus.cc:3037] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:58.945657 28559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bd716d9f1cd4f1aaf8e54e4273b80b7" candidate_uuid: "4bbae82cedcc45eebbe69b574c6d969b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173328857f834b2d9b43280c60b50daf"
I20260808 08:29:58.945803 28559 raft_consensus.cc:3037] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:29:58.946925 28413 raft_consensus.cc:2454] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bbae82cedcc45eebbe69b574c6d969b in term 1.
I20260808 08:29:58.946936 28559 raft_consensus.cc:2454] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bbae82cedcc45eebbe69b574c6d969b in term 1.
I20260808 08:29:58.947213 28194 leader_election.cc:302] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173328857f834b2d9b43280c60b50daf, 4bbae82cedcc45eebbe69b574c6d969b; no voters:
I20260808 08:29:58.947389 28729 raft_consensus.cc:2781] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:29:58.947610 28729 raft_consensus.cc:686] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 LEADER]: Becoming Leader. State: Replica: 4bbae82cedcc45eebbe69b574c6d969b, State: Running, Role: LEADER
I20260808 08:29:58.947944 28729 consensus_queue.cc:237] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } }
I20260808 08:29:58.950362 28097 catalog_manager.cc:5495] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1). New cstate: current_term: 1 leader_uuid: "4bbae82cedcc45eebbe69b574c6d969b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bbae82cedcc45eebbe69b574c6d969b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 } health_report { overall_health: UNKNOWN } } }
I20260808 08:29:58.967947 28744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:58.964240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47618 (local address 127.25.170.1:45481)
0808 08:29:58.964523 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:58.964533 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:58.964546 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:29:58.964613 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:58.964615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:58.964663 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:58.964811 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:58.964991 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.965511 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.966319 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.966554 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.966692 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:58.966988 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:58.967466 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:58.967603 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:58.967665 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 08:29:58.967723 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":133,"threads_started":1}
I20260808 08:29:58.977950 28732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:58.974781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:56257 (local address 127.25.170.2:43777)
0808 08:29:58.974945 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:58.974948 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:58.975052 (+ 104us) server_negotiation.cc:407] Connection header received
0808 08:29:58.975156 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:58.975159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:58.975267 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:58.975352 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:58.975565 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.976116 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.977015 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.977220 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.977314 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:58.977565 (+ 251us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:58.977632 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:58.977688 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:58.977792 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 08:29:58.977845 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:29:58.977958 28747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:58.974649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:43777 (local address 127.25.170.1:56257)
0808 08:29:58.974949 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:58.974962 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:58.975074 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:58.975365 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:58.975367 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:58.975373 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:29:58.975465 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:58.975469 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.976232 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.976234 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:58.976909 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:58.976919 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:58.977337 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:58.977339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:58.977409 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:58.977450 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:29:58.977709 (+ 259us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:29:58.977714 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:29:58.977767 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 08:29:58.977838 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":95,"threads_started":1}
I20260808 08:29:58.984275 28413 raft_consensus.cc:1261] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Refusing update from remote peer 4bbae82cedcc45eebbe69b574c6d969b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:58.984272 28559 raft_consensus.cc:1261] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Refusing update from remote peer 4bbae82cedcc45eebbe69b574c6d969b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:29:58.984760 28742 consensus_queue.cc:1035] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [LEADER]: Connected to new peer: Peer: permanent_uuid: "98cb75ef2647456b9c79133a74a5d142" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 43777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:58.984954 28729 consensus_queue.cc:1035] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [LEADER]: Connected to new peer: Peer: permanent_uuid: "173328857f834b2d9b43280c60b50daf" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:29:59.003682 28744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:59.000030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:55837 (local address 127.25.170.1:45481)
0808 08:29:59.000260 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:29:59.000266 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:29:59.000389 (+ 123us) server_negotiation.cc:407] Connection header received
0808 08:29:59.000546 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:29:59.000549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:29:59.000596 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:29:59.000708 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:29:59.000961 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:59.001614 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:59.002608 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:29:59.002879 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:29:59.002984 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:59.003317 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:29:59.003388 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:29:59.003447 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 08:29:59.003533 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 08:29:59.003578 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260808 08:29:59.003754 28751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:29:58.999963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45481 (local address 127.25.170.2:55837)
0808 08:29:59.000243 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 08:29:59.000259 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:29:59.000437 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:29:59.000719 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:29:59.000722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:29:59.000730 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:29:59.000849 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:59.000862 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:59.001726 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:59.001731 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:59.002489 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:29:59.002498 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:29:59.003005 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:29:59.003009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:29:59.003139 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:29:59.003179 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:29:59.003468 (+ 289us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:29:59.003474 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 08:29:59.003526 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 08:29:59.003604 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":115,"threads_started":1}
W20260808 08:29:59.004794 28694 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 08:30:00.562690 28097 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:00.562876 28097 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:00.565109 28097 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbbde8a0c82c40d18deb072d496a816f: Sending DeleteTablet for 3 replicas of tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7
I20260808 08:30:00.565632 28246 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:00 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:47616
I20260808 08:30:00.565709 28391 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:00 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:52652
I20260808 08:30:00.565784 28536 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:00 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:46146
I20260808 08:30:00.566033 28777 tablet_replica.cc:330] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142: stopping tablet replica
I20260808 08:30:00.566119 28776 tablet_replica.cc:330] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b: stopping tablet replica
I20260808 08:30:00.566197 28777 raft_consensus.cc:2229] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:00.566193 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 28176
I20260808 08:30:00.566224 28776 raft_consensus.cc:2229] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 4bbae82cedcc45eebbe69b574c6d969b [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:30:00.566300 28777 raft_consensus.cc:2258] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:00.567744 28777 ts_tablet_manager.cc:1905] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:00.569419 28778 tablet_replica.cc:330] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf: stopping tablet replica
I20260808 08:30:00.569600 28778 raft_consensus.cc:2229] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:00.569742 28778 raft_consensus.cc:2258] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:00.570504 28778 ts_tablet_manager.cc:1905] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:00.571051 28777 ts_tablet_manager.cc:1918] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:30:00.571149 28777 log.cc:1196] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/2bd716d9f1cd4f1aaf8e54e4273b80b7
I20260808 08:30:00.571439 28777 ts_tablet_manager.cc:1939] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 98cb75ef2647456b9c79133a74a5d142: Deleting consensus metadata
I20260808 08:30:00.572484 28082 catalog_manager.cc:4841] TS 98cb75ef2647456b9c79133a74a5d142 (127.25.170.2:43777): tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7 (table test-table [id=ad4ddaeef4f94ba7ace23aea4a995c0d]) successfully deleted
I20260808 08:30:00.573755 28778 ts_tablet_manager.cc:1918] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:30:00.573892 28778 log.cc:1196] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/2bd716d9f1cd4f1aaf8e54e4273b80b7
I20260808 08:30:00.574149 28778 ts_tablet_manager.cc:1939] T 2bd716d9f1cd4f1aaf8e54e4273b80b7 P 173328857f834b2d9b43280c60b50daf: Deleting consensus metadata
I20260808 08:30:00.574790 28081 catalog_manager.cc:4841] TS 173328857f834b2d9b43280c60b50daf (127.25.170.3:38771): tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7 (table test-table [id=ad4ddaeef4f94ba7ace23aea4a995c0d]) successfully deleted
W20260808 08:30:00.581123 28080 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:45481 (error 108)
I20260808 08:30:00.581295 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 28325
I20260808 08:30:00.584066 28781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:00.583449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45481 (local address 127.0.0.1:39576)
0808 08:30:00.583785 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:00.583931 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:45481: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":82,"threads_started":1}
W20260808 08:30:00.584185 28080 catalog_manager.cc:4584] TS 4bbae82cedcc45eebbe69b574c6d969b (127.25.170.1:45481): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2bd716d9f1cd4f1aaf8e54e4273b80b7: Network error: Client connection negotiation failed: client connection to 127.25.170.1:45481: connect: Connection refused (error 111)
I20260808 08:30:00.591025 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 28470
I20260808 08:30:00.599506 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 28064
2026-08-08T08:30:00Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6236 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:00 dist-test-slave-zkpd krb5kdc[28784](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:00 dist-test-slave-zkpd krb5kdc[28784](info): set up 2 sockets
Aug 08 08:30:00 dist-test-slave-zkpd krb5kdc[28784](info): commencing operation
krb5kdc: starting...
W20260808 08:30:01.668731 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:01 dist-test-slave-zkpd krb5kdc[28784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:30:01.793143 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40721
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:40721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:01.904811 28798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:01.905053 28798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:01.905117 28798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:01.909055 28798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:01.909104 28798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:01.909124 28798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:01.909165 28798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:01.909196 28798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:01.914361 28798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:40721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:01.915374 28798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:01.916442 28798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:01.924661 28806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:01.924688 28804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:01.924743 28803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:01.925093 28798 server_base.cc:1034] running on GCE node
I20260808 08:30:01.925669 28798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:01.926749 28798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:01.927968 28798 hybrid_clock.cc:648] HybridClock initialized: now 1786177801927949 us; error 32 us; skew 500 ppm
Aug 08 08:30:01 dist-test-slave-zkpd krb5kdc[28784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177801, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:01.930625 28798 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:30:01.931538 28798 webserver.cc:460] Webserver started at http://127.25.170.62:39387/ using document root <none> and password file <none>
I20260808 08:30:01.932152 28798 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:01.932242 28798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:01.932473 28798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:01.934481 28798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "7d2a49f92eea47b389f0abb314ba1805"
format_stamp: "Formatted at 2026-08-08 08:30:01 on dist-test-slave-zkpd"
server_key: "17e72e077da806b7e7966fc0f56bae40"
server_key_iv: "8f76f21271a8f9d4a0994269d1d4a127"
server_key_version: "encryptionkey@0"
I20260808 08:30:01.935058 28798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "7d2a49f92eea47b389f0abb314ba1805"
format_stamp: "Formatted at 2026-08-08 08:30:01 on dist-test-slave-zkpd"
server_key: "17e72e077da806b7e7966fc0f56bae40"
server_key_iv: "8f76f21271a8f9d4a0994269d1d4a127"
server_key_version: "encryptionkey@0"
I20260808 08:30:01.938721 28798 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 08:30:01.941241 28815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:01.942444 28798 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:01.942586 28798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "7d2a49f92eea47b389f0abb314ba1805"
format_stamp: "Formatted at 2026-08-08 08:30:01 on dist-test-slave-zkpd"
server_key: "17e72e077da806b7e7966fc0f56bae40"
server_key_iv: "8f76f21271a8f9d4a0994269d1d4a127"
server_key_version: "encryptionkey@0"
I20260808 08:30:01.942694 28798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:01.963425 28798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:01.966668 28798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:01.966915 28798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:01.974747 28798 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:40721
I20260808 08:30:01.974766 28869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:40721 every 8 connection(s)
I20260808 08:30:01.975744 28798 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:01.978794 28870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:01.979317 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 28798
I20260808 08:30:01.979436 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:01.979748 26280 external_mini_cluster.cc:1428] Setting key 3dcd042d57822c9dcdbc45eadf41846a
I20260808 08:30:01.986291 28870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805: Bootstrap starting.
Aug 08 08:30:01 dist-test-slave-zkpd krb5kdc[28784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:01.989264 28870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:01.990051 28870 log.cc:824] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:01.992167 28870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805: No bootstrap required, opened a new log
I20260808 08:30:01.994400 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:01.981208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49246 (local address 127.25.170.62:40721)
0808 08:30:01.981646 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:01.981679 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:01.981718 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:30:01.982410 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:01.982429 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:01.982759 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:01.983054 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:01.984030 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:01.985036 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:01.986194 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:01.986719 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:01.986852 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:01.989689 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:01.989694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:01.989708 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:01.989738 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:01.991523 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:01.992024 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:01.992029 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:01.992034 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:01.992150 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:01.992472 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:01.992475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:01.992476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:01.992869 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:01.993069 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:01.993384 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 08:30:01.993671 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":157,"threads_started":1}
I20260808 08:30:01.995999 28870 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2a49f92eea47b389f0abb314ba1805" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40721 } }
I20260808 08:30:01.996245 28870 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:01.996327 28870 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2a49f92eea47b389f0abb314ba1805, State: Initialized, Role: FOLLOWER
I20260808 08:30:01.996827 28870 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2a49f92eea47b389f0abb314ba1805" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40721 } }
I20260808 08:30:01.996956 28870 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:01.997004 28870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:01.997076 28870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:01.997921 28870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2a49f92eea47b389f0abb314ba1805" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40721 } }
I20260808 08:30:01.998231 28870 leader_election.cc:302] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d2a49f92eea47b389f0abb314ba1805; no voters:
I20260808 08:30:01.998502 28870 leader_election.cc:288] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:01.998642 28875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:01.998900 28875 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2a49f92eea47b389f0abb314ba1805, State: Running, Role: LEADER
I20260808 08:30:01.999238 28875 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2a49f92eea47b389f0abb314ba1805" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40721 } }
I20260808 08:30:01.999774 28870 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:02.000941 28877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d2a49f92eea47b389f0abb314ba1805. Latest consensus state: current_term: 1 leader_uuid: "7d2a49f92eea47b389f0abb314ba1805" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2a49f92eea47b389f0abb314ba1805" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40721 } } }
I20260808 08:30:02.001072 28877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:02.001401 28876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d2a49f92eea47b389f0abb314ba1805" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2a49f92eea47b389f0abb314ba1805" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40721 } } }
I20260808 08:30:02.001513 28876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:02.002238 28884 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:02.005038 28884 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:02.010535 28884 catalog_manager.cc:1347] Generated new cluster ID: 770185a1038d4f8d935ba9ac1e1d9c83
I20260808 08:30:02.010615 28884 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:02.022974 28884 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:02.024001 28884 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:02.032687 28884 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d2a49f92eea47b389f0abb314ba1805: Generated new TSK 0
I20260808 08:30:02.033396 28884 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:30:02.067464 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40721
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:02.184880 28897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:02.185120 28897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:02.185163 28897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:02.189339 28897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:02.189399 28897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:02.189491 28897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:02.194815 28897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:02.195878 28897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:02.196928 28897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:02.206750 28903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:02.206749 28905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:02.206959 28897 server_base.cc:1034] running on GCE node
W20260808 08:30:02.206727 28902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:02.207492 28897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:02.208138 28897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:02.209297 28897 hybrid_clock.cc:648] HybridClock initialized: now 1786177802209284 us; error 25 us; skew 500 ppm
Aug 08 08:30:02 dist-test-slave-zkpd krb5kdc[28784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177802, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:02.212157 28897 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:30:02.212982 28897 webserver.cc:460] Webserver started at http://127.25.170.1:32857/ using document root <none> and password file <none>
I20260808 08:30:02.213539 28897 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:02.213601 28897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:02.213855 28897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:02.215997 28897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "5243bd7fd8284901a04aae08dbeda177"
format_stamp: "Formatted at 2026-08-08 08:30:02 on dist-test-slave-zkpd"
server_key: "ea3cfb7f67a8d5d1b7fca539d91add9f"
server_key_iv: "b7d942ed84285708abb24bf92edd463a"
server_key_version: "encryptionkey@0"
I20260808 08:30:02.216570 28897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "5243bd7fd8284901a04aae08dbeda177"
format_stamp: "Formatted at 2026-08-08 08:30:02 on dist-test-slave-zkpd"
server_key: "ea3cfb7f67a8d5d1b7fca539d91add9f"
server_key_iv: "b7d942ed84285708abb24bf92edd463a"
server_key_version: "encryptionkey@0"
I20260808 08:30:02.220336 28897 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:30:02.222756 28912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:02.223969 28897 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:02.224085 28897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "5243bd7fd8284901a04aae08dbeda177"
format_stamp: "Formatted at 2026-08-08 08:30:02 on dist-test-slave-zkpd"
server_key: "ea3cfb7f67a8d5d1b7fca539d91add9f"
server_key_iv: "b7d942ed84285708abb24bf92edd463a"
server_key_version: "encryptionkey@0"
I20260808 08:30:02.224186 28897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:02.246268 28897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:02.249671 28897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:02.249878 28897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:02.250476 28897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:02.251284 28897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:02.251339 28897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:02.251405 28897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:02.251437 28897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:02.260653 28897 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:44301
I20260808 08:30:02.260679 29035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:44301 every 8 connection(s)
I20260808 08:30:02.261555 28897 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:02.265086 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 28897
I20260808 08:30:02.265250 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:02.265538 26280 external_mini_cluster.cc:1428] Setting key c016d1554d82fffb9dd68f13f330f7b5
Aug 08 08:30:02 dist-test-slave-zkpd krb5kdc[28784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177802, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:02.276047 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:02.263482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:40121 (local address 127.25.170.62:40721)
0808 08:30:02.263617 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:02.263620 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:02.264547 (+ 927us) server_negotiation.cc:407] Connection header received
0808 08:30:02.266054 (+ 1507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:02.266057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:02.266118 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:02.266220 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:02.267383 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.267992 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.269137 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.269381 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.269493 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:02.272316 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:02.272320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:02.272322 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:02.272345 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:02.273899 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:02.274434 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:02.274438 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:02.274439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:02.274525 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:02.274881 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:02.274885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:02.274886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:02.275078 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:02.275186 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:02.275704 (+ 518us) server_negotiation.cc:299] Negotiation successful
0808 08:30:02.275850 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
I20260808 08:30:02.276943 29038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:02.263856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40721 (local address 127.25.170.1:40121)
0808 08:30:02.264396 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:02.264439 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:02.265831 (+ 1392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:02.266409 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:02.266416 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:02.266757 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:02.267234 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:02.267249 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.268122 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.268125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:02.269001 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:02.269010 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.269534 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.269538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:02.269704 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:02.270313 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:02.270330 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:02.272147 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:02.274025 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:02.274031 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:02.274047 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:02.274325 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:02.274618 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:02.274621 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:02.274623 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:02.274770 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:02.275187 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:02.275195 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:02.275463 (+ 268us) client_negotiation.cc:769] Sending connection context
0808 08:30:02.275662 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 08:30:02.276037 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":135,"threads_started":1}
I20260808 08:30:02.278290 29036 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40721
I20260808 08:30:02.278537 29036 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:02.279119 29036 heartbeater.cc:511] Master 127.25.170.62:40721 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:30:02.280907 28833 ts_manager.cc:194] Registered new tserver with Master: 5243bd7fd8284901a04aae08dbeda177 (127.25.170.1:44301)
I20260808 08:30:02.282095 28833 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:40121
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:30:02.295130 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40721
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:02.414394 29041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:02.414626 29041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:02.414667 29041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:02.418713 29041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:02.418771 29041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:02.418828 29041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:02.424142 29041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:02.425145 29041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:02.426136 29041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:02.435993 29049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:02.436065 29041 server_base.cc:1034] running on GCE node
W20260808 08:30:02.436031 29047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:02.436031 29051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:02.436715 29041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:02.437331 29041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:02.438512 29041 hybrid_clock.cc:648] HybridClock initialized: now 1786177802438494 us; error 30 us; skew 500 ppm
Aug 08 08:30:02 dist-test-slave-zkpd krb5kdc[28784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177802, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:02.441372 29041 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:30:02.442212 29041 webserver.cc:460] Webserver started at http://127.25.170.2:35005/ using document root <none> and password file <none>
I20260808 08:30:02.442763 29041 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:02.442859 29041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:02.443086 29041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:02.445178 29041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "a25c1d6767ea49a3a1d7d9ce82bb6dce"
format_stamp: "Formatted at 2026-08-08 08:30:02 on dist-test-slave-zkpd"
server_key: "27e0143118049e5bd1be88ddda141359"
server_key_iv: "8bd23bcee2898df9eb3b4570df5e5a02"
server_key_version: "encryptionkey@0"
I20260808 08:30:02.445748 29041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "a25c1d6767ea49a3a1d7d9ce82bb6dce"
format_stamp: "Formatted at 2026-08-08 08:30:02 on dist-test-slave-zkpd"
server_key: "27e0143118049e5bd1be88ddda141359"
server_key_iv: "8bd23bcee2898df9eb3b4570df5e5a02"
server_key_version: "encryptionkey@0"
I20260808 08:30:02.449517 29041 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:30:02.451965 29058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:02.453188 29041 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:30:02.453322 29041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "a25c1d6767ea49a3a1d7d9ce82bb6dce"
format_stamp: "Formatted at 2026-08-08 08:30:02 on dist-test-slave-zkpd"
server_key: "27e0143118049e5bd1be88ddda141359"
server_key_iv: "8bd23bcee2898df9eb3b4570df5e5a02"
server_key_version: "encryptionkey@0"
I20260808 08:30:02.453429 29041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:02.481596 29041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:02.484916 29041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:02.485113 29041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:02.485694 29041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:02.486507 29041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:02.486575 29041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:02.486645 29041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:02.486685 29041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:02.495836 29041 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:43983
I20260808 08:30:02.495886 29183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:43983 every 8 connection(s)
I20260808 08:30:02.496716 29041 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:02.502270 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 29041
I20260808 08:30:02.502424 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:02.502715 26280 external_mini_cluster.cc:1428] Setting key 0dca3e1b322eb471fb94a2f7f03e3973
Aug 08 08:30:02 dist-test-slave-zkpd krb5kdc[28784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177802, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:02.511461 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:02.498540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:37761 (local address 127.25.170.62:40721)
0808 08:30:02.498672 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:02.498676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:02.499473 (+ 797us) server_negotiation.cc:407] Connection header received
0808 08:30:02.501021 (+ 1548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:02.501024 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:02.501081 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:02.501189 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:02.502444 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.503182 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.504531 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.504765 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.504879 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:02.507414 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:02.507421 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:02.507427 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:02.507462 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:02.509280 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:02.509790 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:02.509795 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:02.509798 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:02.509894 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:02.510244 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:02.510249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:02.510261 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:02.510540 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:02.510652 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:02.511110 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 08:30:02.511278 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:30:02.512099 29186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:02.498905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40721 (local address 127.25.170.2:37761)
0808 08:30:02.499328 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:02.499369 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:02.500783 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:02.501355 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:02.501362 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:02.501684 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:02.502230 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:02.502251 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.503350 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.503353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:02.504402 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:02.504413 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.504917 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.504921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:02.505078 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:02.505634 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:02.505649 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:02.507242 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:02.509432 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:02.509437 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:02.509448 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:02.509687 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:02.510023 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:02.510025 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:02.510026 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:02.510148 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:02.510655 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:02.510659 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:02.510880 (+ 221us) client_negotiation.cc:769] Sending connection context
0808 08:30:02.511022 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 08:30:02.511257 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":108,"threads_started":1}
I20260808 08:30:02.513236 29184 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40721
I20260808 08:30:02.513502 29184 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:02.514111 29184 heartbeater.cc:511] Master 127.25.170.62:40721 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:30:02.515216 28833 ts_manager.cc:194] Registered new tserver with Master: a25c1d6767ea49a3a1d7d9ce82bb6dce (127.25.170.2:43983)
I20260808 08:30:02.515816 28833 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:37761
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:30:02.532756 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40721
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:02.646234 29189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:02.646464 29189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:02.646538 29189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:02.650899 29189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:02.650961 29189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:02.651098 29189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:02.656880 29189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:02.657944 29189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:02.658974 29189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:02.669011 29194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:02.669052 29189 server_base.cc:1034] running on GCE node
W20260808 08:30:02.669073 29197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:02.669035 29195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:02.669636 29189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:02.670279 29189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:02.671484 29189 hybrid_clock.cc:648] HybridClock initialized: now 1786177802671461 us; error 50 us; skew 500 ppm
Aug 08 08:30:02 dist-test-slave-zkpd krb5kdc[28784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177802, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:02.674381 29189 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:30:02.675289 29189 webserver.cc:460] Webserver started at http://127.25.170.3:45653/ using document root <none> and password file <none>
I20260808 08:30:02.675843 29189 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:02.675966 29189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:02.676148 29189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:02.678100 29189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "bb5f97d0ea6441e2978a162d6b7ee943"
format_stamp: "Formatted at 2026-08-08 08:30:02 on dist-test-slave-zkpd"
server_key: "41ff6214aad6c7c23e7bb7b2f1af5f3d"
server_key_iv: "3e29e09490b6598aaeb80254212c63cd"
server_key_version: "encryptionkey@0"
I20260808 08:30:02.678630 29189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "bb5f97d0ea6441e2978a162d6b7ee943"
format_stamp: "Formatted at 2026-08-08 08:30:02 on dist-test-slave-zkpd"
server_key: "41ff6214aad6c7c23e7bb7b2f1af5f3d"
server_key_iv: "3e29e09490b6598aaeb80254212c63cd"
server_key_version: "encryptionkey@0"
I20260808 08:30:02.682219 29189 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:30:02.684391 29204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:02.685532 29189 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:02.685664 29189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "bb5f97d0ea6441e2978a162d6b7ee943"
format_stamp: "Formatted at 2026-08-08 08:30:02 on dist-test-slave-zkpd"
server_key: "41ff6214aad6c7c23e7bb7b2f1af5f3d"
server_key_iv: "3e29e09490b6598aaeb80254212c63cd"
server_key_version: "encryptionkey@0"
I20260808 08:30:02.685801 29189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:02.710151 29189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:02.712986 29189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:02.713186 29189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:02.713799 29189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:02.714596 29189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:02.714669 29189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:02.714748 29189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:02.714792 29189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:02.724350 29189 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:45761
I20260808 08:30:02.724403 29324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:45761 every 8 connection(s)
I20260808 08:30:02.725275 29189 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:02.729318 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 29189
I20260808 08:30:02.729442 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:02.729743 26280 external_mini_cluster.cc:1428] Setting key 6bd5483e80fcede814519d98db857517
Aug 08 08:30:02 dist-test-slave-zkpd krb5kdc[28784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177802, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:02.739178 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:02.727201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:33109 (local address 127.25.170.62:40721)
0808 08:30:02.727392 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:02.727397 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:02.728302 (+ 905us) server_negotiation.cc:407] Connection header received
0808 08:30:02.729958 (+ 1656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:02.729961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:02.730009 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:02.730103 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:02.731541 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.732242 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.733376 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.733590 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.733675 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:02.736144 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:02.736147 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:02.736150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:02.736172 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:02.737442 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:02.737900 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:02.737903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:02.737904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:02.737980 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:02.738291 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:02.738294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:02.738295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:02.738464 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:02.738541 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:02.738972 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 08:30:02.739062 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 08:30:02.740018 29327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:02.727611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40721 (local address 127.25.170.3:33109)
0808 08:30:02.728151 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:02.728194 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:02.729696 (+ 1502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:02.730284 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:02.730292 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:02.730801 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:02.731409 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:02.731424 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.732369 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.732372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:02.733256 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:02.733266 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:02.733731 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:02.733734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:02.733892 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:02.734493 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:02.734509 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:02.735991 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:02.737547 (+ 1556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:02.737551 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:02.737561 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:02.737807 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:02.738066 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:02.738068 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:02.738069 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:02.738196 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:02.738555 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:02.738560 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:02.738768 (+ 208us) client_negotiation.cc:769] Sending connection context
0808 08:30:02.738915 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 08:30:02.739141 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":157,"threads_started":1}
I20260808 08:30:02.741104 29325 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40721
I20260808 08:30:02.741304 29325 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:02.741732 29325 heartbeater.cc:511] Master 127.25.170.62:40721 requested a full tablet report, sending...
I20260808 08:30:02.742762 28832 ts_manager.cc:194] Registered new tserver with Master: bb5f97d0ea6441e2978a162d6b7ee943 (127.25.170.3:45761)
I20260808 08:30:02.743449 28832 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:33109
I20260808 08:30:02.743582 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:30:02.758351 28873 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:02.756877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49256 (local address 127.25.170.62:40721)
0808 08:30:02.757017 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:02.757022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:02.757213 (+ 191us) server_negotiation.cc:407] Connection header received
0808 08:30:02.757327 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:02.757329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:02.757368 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:02.757438 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:02.758203 (+ 765us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49256: BlockingRecv error: recv got EOF from 127.0.0.1:49256 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:30:02.759294 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 28897
I20260808 08:30:02.768556 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 29041
I20260808 08:30:02.775046 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 29189
I20260808 08:30:02.783711 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 28798
2026-08-08T08:30:02Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2182 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:02 dist-test-slave-zkpd krb5kdc[29337](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:02 dist-test-slave-zkpd krb5kdc[29337](info): set up 2 sockets
Aug 08 08:30:02 dist-test-slave-zkpd krb5kdc[29337](info): commencing operation
krb5kdc: starting...
W20260808 08:30:03.934329 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:04 dist-test-slave-zkpd krb5kdc[29337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:30:04.054996 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:41235
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:40999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:41235
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:04.164908 29351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:04.165192 29351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:04.165273 29351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:04.169238 29351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:04.169333 29351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:04.169373 29351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:04.169432 29351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:04.169472 29351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:04.174533 29351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:40999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:41235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:41235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:04.175539 29351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:04.176553 29351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:04.184933 29361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:04.184944 29357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:04.184971 29358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:04.185098 29351 server_base.cc:1034] running on GCE node
I20260808 08:30:04.185731 29351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:04.186734 29351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:04.187953 29351 hybrid_clock.cc:648] HybridClock initialized: now 1786177804187928 us; error 33 us; skew 500 ppm
Aug 08 08:30:04 dist-test-slave-zkpd krb5kdc[29337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177804, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:04.194933 29351 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:30:04.195793 29351 webserver.cc:460] Webserver started at http://127.25.170.62:34475/ using document root <none> and password file <none>
I20260808 08:30:04.196368 29351 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:04.196461 29351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:04.196693 29351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:04.198752 29351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f"
format_stamp: "Formatted at 2026-08-08 08:30:04 on dist-test-slave-zkpd"
server_key: "70afdd004efb1992edda105b49b58cbe"
server_key_iv: "b3d2820d75c20efd4c6b520632b6ea46"
server_key_version: "encryptionkey@0"
I20260808 08:30:04.199321 29351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f"
format_stamp: "Formatted at 2026-08-08 08:30:04 on dist-test-slave-zkpd"
server_key: "70afdd004efb1992edda105b49b58cbe"
server_key_iv: "b3d2820d75c20efd4c6b520632b6ea46"
server_key_version: "encryptionkey@0"
I20260808 08:30:04.203014 29351 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:30:04.205405 29368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:04.206621 29351 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:04.206768 29351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f"
format_stamp: "Formatted at 2026-08-08 08:30:04 on dist-test-slave-zkpd"
server_key: "70afdd004efb1992edda105b49b58cbe"
server_key_iv: "b3d2820d75c20efd4c6b520632b6ea46"
server_key_version: "encryptionkey@0"
I20260808 08:30:04.206884 29351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:04.218811 29351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:04.221611 29351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:04.221805 29351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:04.229074 29351 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:41235
I20260808 08:30:04.229347 29423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:41235 every 8 connection(s)
I20260808 08:30:04.230088 29351 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:04.230836 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 29351
I20260808 08:30:04.230967 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:04.231263 26280 external_mini_cluster.cc:1428] Setting key 5a85f72a64d133b8c7f03a71639fa694
I20260808 08:30:04.233094 29424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:04.239691 29424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f: Bootstrap starting.
Aug 08 08:30:04 dist-test-slave-zkpd krb5kdc[29337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:04.242285 29424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:04.243173 29424 log.cc:824] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:04.245034 29424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f: No bootstrap required, opened a new log
I20260808 08:30:04.246162 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:04.232641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40412 (local address 127.25.170.62:41235)
0808 08:30:04.233053 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:04.233071 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:04.233115 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:30:04.233944 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:04.233966 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:04.234362 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:04.234711 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:04.235422 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:04.236939 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:04.237839 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:04.238536 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:04.238688 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:04.241417 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:04.241423 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:04.241438 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:04.241467 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:04.243358 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:04.243823 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:04.243830 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:04.243842 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:04.244016 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:04.244340 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:04.244344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:04.244346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:04.244728 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:04.244937 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:04.245216 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 08:30:04.245506 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":113,"threads_started":1}
I20260808 08:30:04.249199 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:30:04.249133 29424 raft_consensus.cc:348] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41235 } }
I20260808 08:30:04.249423 29424 raft_consensus.cc:374] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:04.249491 29424 raft_consensus.cc:729] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f94aeb6a6839404ab6afc6cfd13ddd9f, State: Initialized, Role: FOLLOWER
I20260808 08:30:04.249920 29424 consensus_queue.cc:260] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41235 } }
I20260808 08:30:04.250068 29424 raft_consensus.cc:388] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:04.250134 29424 raft_consensus.cc:482] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:04.250227 29424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:04.251048 29424 raft_consensus.cc:504] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41235 } }
I20260808 08:30:04.251376 29424 leader_election.cc:302] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f94aeb6a6839404ab6afc6cfd13ddd9f; no voters:
I20260808 08:30:04.251699 29424 leader_election.cc:288] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:04.251773 29430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:04.252054 29430 raft_consensus.cc:686] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [term 1 LEADER]: Becoming Leader. State: Replica: f94aeb6a6839404ab6afc6cfd13ddd9f, State: Running, Role: LEADER
I20260808 08:30:04.252403 29430 consensus_queue.cc:237] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41235 } }
I20260808 08:30:04.252967 29424 sys_catalog.cc:564] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:04.253969 29431 sys_catalog.cc:455] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41235 } } }
I20260808 08:30:04.254098 29431 sys_catalog.cc:458] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:04.254338 29431 sys_catalog.cc:455] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader f94aeb6a6839404ab6afc6cfd13ddd9f. Latest consensus state: current_term: 1 leader_uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f94aeb6a6839404ab6afc6cfd13ddd9f" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41235 } } }
I20260808 08:30:04.254427 29431 sys_catalog.cc:458] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:04.255254 29439 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:04.258401 29439 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:04.263886 29439 catalog_manager.cc:1347] Generated new cluster ID: ad1a8f6134a340df887350bfcac8e28a
I20260808 08:30:04.264022 29439 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:04.270714 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:04.264680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40424 (local address 127.25.170.62:41235)
0808 08:30:04.264819 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:04.264824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:04.265158 (+ 334us) server_negotiation.cc:407] Connection header received
0808 08:30:04.265300 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:04.265303 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:04.265354 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:04.265437 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:04.266054 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:04.266882 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:04.268140 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:04.268559 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:04.268667 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:04.269644 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:04.269648 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:04.269651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:04.270202 (+ 551us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:04.270248 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:04.270269 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:04.270369 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:04.270510 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 08:30:04.270568 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:30:04.273030 29439 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:04.274174 29439 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:04.287870 29439 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f94aeb6a6839404ab6afc6cfd13ddd9f: Generated new TSK 0
I20260808 08:30:04.288654 29439 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:30:04.301582 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 29351
2026-08-08T08:30:04Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1516 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:04 dist-test-slave-zkpd krb5kdc[29459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:04 dist-test-slave-zkpd krb5kdc[29459](info): set up 2 sockets
Aug 08 08:30:04 dist-test-slave-zkpd krb5kdc[29459](info): commencing operation
krb5kdc: starting...
W20260808 08:30:05.357604 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:05 dist-test-slave-zkpd krb5kdc[29459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:30:05.482368 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33775
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:33775
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:05.592684 29472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:05.592928 29472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:05.592967 29472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:05.596840 29472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:05.596886 29472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:05.596904 29472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:05.596921 29472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:05.596936 29472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:05.601946 29472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:33775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:05.602859 29472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:05.603763 29472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:05.612118 29480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:05.612131 29478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:05.612138 29477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:05.612277 29472 server_base.cc:1034] running on GCE node
I20260808 08:30:05.612941 29472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:05.613992 29472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:05.615173 29472 hybrid_clock.cc:648] HybridClock initialized: now 1786177805615160 us; error 28 us; skew 500 ppm
Aug 08 08:30:05 dist-test-slave-zkpd krb5kdc[29459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177805, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:05.617846 29472 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:30:05.618628 29472 webserver.cc:460] Webserver started at http://127.25.170.62:34671/ using document root <none> and password file <none>
I20260808 08:30:05.619119 29472 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:05.619176 29472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:05.619342 29472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:05.621320 29472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "a74500d7839744768fa27744623d400e"
format_stamp: "Formatted at 2026-08-08 08:30:05 on dist-test-slave-zkpd"
server_key: "a72e39303f957a02919611bce6708261"
server_key_iv: "a55799c088b209f0a2c4bdee14b08569"
server_key_version: "encryptionkey@0"
I20260808 08:30:05.621826 29472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "a74500d7839744768fa27744623d400e"
format_stamp: "Formatted at 2026-08-08 08:30:05 on dist-test-slave-zkpd"
server_key: "a72e39303f957a02919611bce6708261"
server_key_iv: "a55799c088b209f0a2c4bdee14b08569"
server_key_version: "encryptionkey@0"
I20260808 08:30:05.625384 29472 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:30:05.627562 29487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:05.628777 29472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:05.628901 29472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "a74500d7839744768fa27744623d400e"
format_stamp: "Formatted at 2026-08-08 08:30:05 on dist-test-slave-zkpd"
server_key: "a72e39303f957a02919611bce6708261"
server_key_iv: "a55799c088b209f0a2c4bdee14b08569"
server_key_version: "encryptionkey@0"
I20260808 08:30:05.628993 29472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:05.643476 29472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:05.645973 29472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:05.646219 29472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:05.652999 29472 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:33775
I20260808 08:30:05.653263 29542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:33775 every 8 connection(s)
I20260808 08:30:05.653913 29472 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:05.656524 29543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:05.658564 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 29472
I20260808 08:30:05.658699 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:05.658998 26280 external_mini_cluster.cc:1428] Setting key 8d04131a15bf5028bbbc3b96cc5aa84b
I20260808 08:30:05.663180 29543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e: Bootstrap starting.
I20260808 08:30:05.665338 29543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:05.666080 29543 log.cc:824] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:30:05 dist-test-slave-zkpd krb5kdc[29459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:05.667878 29543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e: No bootstrap required, opened a new log
I20260808 08:30:05.671367 29543 raft_consensus.cc:348] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a74500d7839744768fa27744623d400e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33775 } }
I20260808 08:30:05.671612 29543 raft_consensus.cc:374] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:05.671682 29543 raft_consensus.cc:729] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a74500d7839744768fa27744623d400e, State: Initialized, Role: FOLLOWER
I20260808 08:30:05.672168 29543 consensus_queue.cc:260] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a74500d7839744768fa27744623d400e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33775 } }
I20260808 08:30:05.672293 29543 raft_consensus.cc:388] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:05.672379 29543 raft_consensus.cc:482] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:05.672492 29543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:05.672618 29547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:05.660400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47808 (local address 127.25.170.62:33775)
0808 08:30:05.660836 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:05.660850 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:05.660896 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:30:05.661706 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:05.661725 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:05.662032 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:05.662360 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:05.663168 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:05.664248 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:05.665062 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:05.665549 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:05.665709 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:05.668157 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:05.668161 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:05.668173 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:05.668198 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:05.669781 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:05.670215 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:05.670220 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:05.670224 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:05.670336 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:05.670608 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:05.670612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:05.670614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:05.670968 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:05.671189 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:05.671423 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 08:30:05.671755 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":131,"threads_started":1}
I20260808 08:30:05.673540 29543 raft_consensus.cc:504] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a74500d7839744768fa27744623d400e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33775 } }
I20260808 08:30:05.673904 29543 leader_election.cc:302] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a74500d7839744768fa27744623d400e; no voters:
I20260808 08:30:05.674242 29543 leader_election.cc:288] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:05.674324 29549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:05.674492 29549 raft_consensus.cc:686] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [term 1 LEADER]: Becoming Leader. State: Replica: a74500d7839744768fa27744623d400e, State: Running, Role: LEADER
I20260808 08:30:05.674832 29549 consensus_queue.cc:237] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a74500d7839744768fa27744623d400e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33775 } }
I20260808 08:30:05.675447 29543 sys_catalog.cc:564] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:05.676093 29549 sys_catalog.cc:455] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a74500d7839744768fa27744623d400e. Latest consensus state: current_term: 1 leader_uuid: "a74500d7839744768fa27744623d400e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a74500d7839744768fa27744623d400e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33775 } } }
I20260808 08:30:05.676280 29549 sys_catalog.cc:458] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:05.676519 29550 sys_catalog.cc:455] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a74500d7839744768fa27744623d400e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a74500d7839744768fa27744623d400e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33775 } } }
I20260808 08:30:05.676637 29550 sys_catalog.cc:458] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:05.676831 29557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:05.680096 29557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:05.685648 29557 catalog_manager.cc:1347] Generated new cluster ID: b832fcefb8b74cbc9a2e4ca2c8f124f9
I20260808 08:30:05.685746 29557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:05.694597 29557 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:05.695407 29557 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:05.701301 29557 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a74500d7839744768fa27744623d400e: Generated new TSK 0
I20260808 08:30:05.702067 29557 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:30:05.735160 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33775
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:05.847317 29571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:05.847579 29571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:05.847621 29571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:05.851591 29571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:05.851646 29571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:05.851703 29571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:05.856848 29571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:05.857861 29571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:05.858855 29571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:05.868096 29577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:05.868105 29579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:05.868247 29571 server_base.cc:1034] running on GCE node
W20260808 08:30:05.868443 29576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:05.868846 29571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:05.869437 29571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:05.870615 29571 hybrid_clock.cc:648] HybridClock initialized: now 1786177805870596 us; error 30 us; skew 500 ppm
Aug 08 08:30:05 dist-test-slave-zkpd krb5kdc[29459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177805, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:05.873258 29571 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:30:05.874089 29571 webserver.cc:460] Webserver started at http://127.25.170.1:33091/ using document root <none> and password file <none>
I20260808 08:30:05.874639 29571 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:05.874722 29571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:05.874969 29571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:05.877243 29571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "33200551789a4211b66775c761a14262"
format_stamp: "Formatted at 2026-08-08 08:30:05 on dist-test-slave-zkpd"
server_key: "f6838eabc823faacc979f0bc386429d0"
server_key_iv: "603070968e8e8e8ca7e62cbc7d3a14e8"
server_key_version: "encryptionkey@0"
I20260808 08:30:05.877833 29571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "33200551789a4211b66775c761a14262"
format_stamp: "Formatted at 2026-08-08 08:30:05 on dist-test-slave-zkpd"
server_key: "f6838eabc823faacc979f0bc386429d0"
server_key_iv: "603070968e8e8e8ca7e62cbc7d3a14e8"
server_key_version: "encryptionkey@0"
I20260808 08:30:05.881639 29571 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:30:05.884122 29587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:05.885339 29571 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:05.885468 29571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "33200551789a4211b66775c761a14262"
format_stamp: "Formatted at 2026-08-08 08:30:05 on dist-test-slave-zkpd"
server_key: "f6838eabc823faacc979f0bc386429d0"
server_key_iv: "603070968e8e8e8ca7e62cbc7d3a14e8"
server_key_version: "encryptionkey@0"
I20260808 08:30:05.885573 29571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:05.917304 29571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:05.920295 29571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:05.920490 29571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:05.921097 29571 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:05.921949 29571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:05.922015 29571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:05.922083 29571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:05.922130 29571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:05.931183 29571 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:33763
I20260808 08:30:05.931216 29704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:33763 every 8 connection(s)
I20260808 08:30:05.932195 29571 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
Aug 08 08:30:05 dist-test-slave-zkpd krb5kdc[29459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177805, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:05.942075 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 29571
I20260808 08:30:05.942219 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:05.942530 26280 external_mini_cluster.cc:1428] Setting key dca9a481e209d086e353da96124e03fa
I20260808 08:30:05.945595 29547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:05.934049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:36785 (local address 127.25.170.62:33775)
0808 08:30:05.934184 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:05.934187 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:05.934981 (+ 794us) server_negotiation.cc:407] Connection header received
0808 08:30:05.936369 (+ 1388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:05.936372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:05.936422 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:05.936495 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:05.937645 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:05.938171 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:05.939235 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:05.939460 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:05.939536 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:05.941870 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:05.941873 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:05.941875 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:05.941900 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:05.943411 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:05.943918 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:05.943924 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:05.943926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:05.944035 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:05.944382 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:05.944386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:05.944389 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:05.944639 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:05.944750 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:05.945203 (+ 453us) server_negotiation.cc:299] Negotiation successful
0808 08:30:05.945354 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:30:05.946200 29707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:05.934390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33775 (local address 127.25.170.1:36785)
0808 08:30:05.934831 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:05.934874 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:05.936174 (+ 1300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:05.936659 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:05.936665 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:05.937042 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:05.937502 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:05.937515 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:05.938276 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:05.938278 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:05.939132 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:05.939141 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:05.939584 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:05.939586 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:05.939718 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:05.940307 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:05.940323 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:05.941720 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:05.943515 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:05.943519 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:05.943531 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:05.943775 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:05.944144 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:05.944147 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:05.944148 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:05.944281 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:05.944740 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:05.944744 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:05.944975 (+ 231us) client_negotiation.cc:769] Sending connection context
0808 08:30:05.945124 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 08:30:05.945367 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":114,"threads_started":1}
I20260808 08:30:05.947396 29705 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33775
I20260808 08:30:05.947665 29705 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:05.948210 29705 heartbeater.cc:511] Master 127.25.170.62:33775 requested a full tablet report, sending...
I20260808 08:30:05.949893 29506 ts_manager.cc:194] Registered new tserver with Master: 33200551789a4211b66775c761a14262 (127.25.170.1:33763)
I20260808 08:30:05.951581 29506 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:36785
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:30:05.970607 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33775
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:06.084921 29710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:06.085153 29710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:06.085232 29710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:06.089270 29710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:06.089323 29710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:06.089401 29710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:06.094571 29710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:06.095569 29710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:06.096591 29710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:06.106071 29715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:06.106135 29718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:06.106092 29716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:06.106251 29710 server_base.cc:1034] running on GCE node
I20260808 08:30:06.106709 29710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:06.107339 29710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:06.108520 29710 hybrid_clock.cc:648] HybridClock initialized: now 1786177806108500 us; error 30 us; skew 500 ppm
Aug 08 08:30:06 dist-test-slave-zkpd krb5kdc[29459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:06.111191 29710 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:30:06.112128 29710 webserver.cc:460] Webserver started at http://127.25.170.2:38087/ using document root <none> and password file <none>
I20260808 08:30:06.112663 29710 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:06.112748 29710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:06.112985 29710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:06.114961 29710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "e7b68508039b4f2aacbed98b166f3b1e"
format_stamp: "Formatted at 2026-08-08 08:30:06 on dist-test-slave-zkpd"
server_key: "5a20437059dc6b7e060a0a1a4ab7b9bb"
server_key_iv: "e9a3e902fc49272ec905eddefd8011d8"
server_key_version: "encryptionkey@0"
I20260808 08:30:06.115520 29710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "e7b68508039b4f2aacbed98b166f3b1e"
format_stamp: "Formatted at 2026-08-08 08:30:06 on dist-test-slave-zkpd"
server_key: "5a20437059dc6b7e060a0a1a4ab7b9bb"
server_key_iv: "e9a3e902fc49272ec905eddefd8011d8"
server_key_version: "encryptionkey@0"
I20260808 08:30:06.119167 29710 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:30:06.121513 29725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:06.122936 29710 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:06.123070 29710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "e7b68508039b4f2aacbed98b166f3b1e"
format_stamp: "Formatted at 2026-08-08 08:30:06 on dist-test-slave-zkpd"
server_key: "5a20437059dc6b7e060a0a1a4ab7b9bb"
server_key_iv: "e9a3e902fc49272ec905eddefd8011d8"
server_key_version: "encryptionkey@0"
I20260808 08:30:06.123176 29710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:06.142576 29710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:06.145747 29710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:06.145960 29710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:06.146579 29710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:06.147428 29710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:06.147495 29710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:06.147562 29710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:06.147607 29710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:06.156850 29710 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:40663
I20260808 08:30:06.156883 29846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:40663 every 8 connection(s)
I20260808 08:30:06.157732 29710 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:06.166908 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 29710
Aug 08 08:30:06 dist-test-slave-zkpd krb5kdc[29459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:06.167035 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:06.167302 26280 external_mini_cluster.cc:1428] Setting key 700a695a73f641542c202030609d9391
I20260808 08:30:06.171607 29547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:06.159477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:47891 (local address 127.25.170.62:33775)
0808 08:30:06.159642 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:06.159647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:06.160545 (+ 898us) server_negotiation.cc:407] Connection header received
0808 08:30:06.161848 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:06.161851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:06.161898 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:06.162010 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:06.163214 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:06.163726 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:06.164869 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:06.165081 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:06.165160 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:06.167648 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:06.167653 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:06.167657 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:06.167691 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:06.169233 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:06.169858 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:06.169861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:06.169863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:06.169937 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:06.170331 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:06.170333 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:06.170334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:06.170503 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:06.170575 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:06.171242 (+ 667us) server_negotiation.cc:299] Negotiation successful
0808 08:30:06.171394 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:30:06.172477 29850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:06.159946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33775 (local address 127.25.170.2:47891)
0808 08:30:06.160398 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:06.160441 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:06.161652 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:06.162232 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:06.162239 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:06.162604 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:06.163082 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:06.163095 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:06.163832 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:06.163835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:06.164761 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:06.164772 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:06.165207 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:06.165209 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:06.165355 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:06.165880 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:06.165895 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:06.167476 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:06.169349 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:06.169358 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:06.169376 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:06.169753 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:06.170022 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:06.170028 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:06.170032 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:06.170224 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:06.170600 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:06.170609 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:06.170946 (+ 337us) client_negotiation.cc:769] Sending connection context
0808 08:30:06.171151 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 08:30:06.171412 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":106,"threads_started":1}
I20260808 08:30:06.173694 29848 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33775
I20260808 08:30:06.173955 29848 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:06.174439 29848 heartbeater.cc:511] Master 127.25.170.62:33775 requested a full tablet report, sending...
I20260808 08:30:06.175477 29506 ts_manager.cc:194] Registered new tserver with Master: e7b68508039b4f2aacbed98b166f3b1e (127.25.170.2:40663)
I20260808 08:30:06.176218 29506 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:47891
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:30:06.196365 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33775
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:06.308784 29853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:06.309031 29853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:06.309098 29853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:06.313024 29853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:06.313091 29853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:06.313169 29853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:06.318413 29853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:06.319417 29853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:06.320429 29853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:06.329712 29861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:06.329680 29858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:06.329862 29859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:06.329932 29853 server_base.cc:1034] running on GCE node
I20260808 08:30:06.330431 29853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:06.331008 29853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:06.332180 29853 hybrid_clock.cc:648] HybridClock initialized: now 1786177806332163 us; error 38 us; skew 500 ppm
Aug 08 08:30:06 dist-test-slave-zkpd krb5kdc[29459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:06.334780 29853 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:30:06.335575 29853 webserver.cc:460] Webserver started at http://127.25.170.3:40067/ using document root <none> and password file <none>
I20260808 08:30:06.336122 29853 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:06.336184 29853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:06.336342 29853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:06.338176 29853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "2f8d059d684b4452bab3168e366c087a"
format_stamp: "Formatted at 2026-08-08 08:30:06 on dist-test-slave-zkpd"
server_key: "3f2864f342f1f4bd08dfd163e32560b8"
server_key_iv: "f6d7602acacd101809927ab9eb2d6a48"
server_key_version: "encryptionkey@0"
I20260808 08:30:06.338663 29853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "2f8d059d684b4452bab3168e366c087a"
format_stamp: "Formatted at 2026-08-08 08:30:06 on dist-test-slave-zkpd"
server_key: "3f2864f342f1f4bd08dfd163e32560b8"
server_key_iv: "f6d7602acacd101809927ab9eb2d6a48"
server_key_version: "encryptionkey@0"
I20260808 08:30:06.342063 29853 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:30:06.344313 29869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:06.345485 29853 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:06.345578 29853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "2f8d059d684b4452bab3168e366c087a"
format_stamp: "Formatted at 2026-08-08 08:30:06 on dist-test-slave-zkpd"
server_key: "3f2864f342f1f4bd08dfd163e32560b8"
server_key_iv: "f6d7602acacd101809927ab9eb2d6a48"
server_key_version: "encryptionkey@0"
I20260808 08:30:06.345657 29853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:06.355428 29853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:06.357988 29853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:06.358126 29853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:06.358599 29853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:06.359301 29853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:06.359355 29853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:06.359392 29853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:06.359413 29853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:06.368600 29853 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:39065
I20260808 08:30:06.368659 29988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:39065 every 8 connection(s)
I20260808 08:30:06.369426 29853 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:06.372442 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 29853
I20260808 08:30:06.372565 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:06.372852 26280 external_mini_cluster.cc:1428] Setting key 15024ed968dbde9722f5fb49c90f4a92
Aug 08 08:30:06 dist-test-slave-zkpd krb5kdc[29459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177806, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:06.382715 29547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:06.371100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:58655 (local address 127.25.170.62:33775)
0808 08:30:06.371230 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:06.371234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:06.372030 (+ 796us) server_negotiation.cc:407] Connection header received
0808 08:30:06.373511 (+ 1481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:06.373515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:06.373575 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:06.373653 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:06.374769 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:06.375355 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:06.376665 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:06.376906 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:06.377016 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:06.379747 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:06.379750 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:06.379753 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:06.379779 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:06.381032 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:06.381488 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:06.381490 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:06.381491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:06.381568 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:06.381849 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:06.381851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:06.381852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:06.382016 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:06.382089 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:06.382502 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 08:30:06.382599 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:30:06.383462 29991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:06.371419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33775 (local address 127.25.170.3:58655)
0808 08:30:06.371839 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:06.371879 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:06.373298 (+ 1419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:06.373819 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:06.373826 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:06.374155 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:06.374627 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:06.374640 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:06.375480 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:06.375483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:06.376545 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:06.376555 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:06.377054 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:06.377058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:06.377225 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:06.377771 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:06.377787 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:06.379597 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:06.381136 (+ 1539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:06.381140 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:06.381152 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:06.381404 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:06.381642 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:06.381644 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:06.381646 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:06.381769 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:06.382098 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:06.382103 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:06.382312 (+ 209us) client_negotiation.cc:769] Sending connection context
0808 08:30:06.382459 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 08:30:06.382687 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":118,"threads_started":1}
I20260808 08:30:06.384513 29989 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33775
I20260808 08:30:06.384735 29989 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:06.385303 29989 heartbeater.cc:511] Master 127.25.170.62:33775 requested a full tablet report, sending...
I20260808 08:30:06.386413 29505 ts_manager.cc:194] Registered new tserver with Master: 2f8d059d684b4452bab3168e366c087a (127.25.170.3:39065)
I20260808 08:30:06.386978 29505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:58655
I20260808 08:30:06.397904 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:30:06 dist-test-slave-zkpd krb5kdc[29459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177806, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 08:30:06 dist-test-slave-zkpd krb5kdc[29459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177806, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:06.423416 29547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:06.415589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47822 (local address 127.25.170.62:33775)
0808 08:30:06.415710 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:06.415714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:06.415925 (+ 211us) server_negotiation.cc:407] Connection header received
0808 08:30:06.416056 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:06.416059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:06.416103 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:06.416175 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:06.416827 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:06.417337 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:06.418129 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:06.418380 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:06.418465 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:06.420740 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:06.420743 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:06.420745 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:06.420768 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:06.421990 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:06.422365 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:06.422367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:06.422369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:06.422441 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:06.422661 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:06.422663 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:06.422664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:06.422877 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:06.423022 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:06.423198 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 08:30:06.423298 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 08:30:06.423781 29505 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:47822
I20260808 08:30:06.425102 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 29571
I20260808 08:30:06.433497 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 29710
I20260808 08:30:06.440834 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 29853
I20260808 08:30:06.447194 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 29472
2026-08-08T08:30:06Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2146 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:06 dist-test-slave-zkpd krb5kdc[30002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:06 dist-test-slave-zkpd krb5kdc[30002](info): set up 2 sockets
Aug 08 08:30:06 dist-test-slave-zkpd krb5kdc[30002](info): commencing operation
krb5kdc: starting...
W20260808 08:30:07.533473 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:07 dist-test-slave-zkpd krb5kdc[30002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:30:07.656394 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40075
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:40075
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:07.767063 30015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:07.767338 30015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:07.767414 30015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:07.771584 30015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:07.771667 30015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:07.771708 30015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:07.771747 30015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:07.771778 30015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:07.776885 30015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:40075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:07.777871 30015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:07.778882 30015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:07.787101 30023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:07.787127 30021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:07.787125 30020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:07.787263 30015 server_base.cc:1034] running on GCE node
I20260808 08:30:07.787984 30015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:07.789032 30015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:07.790191 30015 hybrid_clock.cc:648] HybridClock initialized: now 1786177807790175 us; error 28 us; skew 500 ppm
Aug 08 08:30:07 dist-test-slave-zkpd krb5kdc[30002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177807, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:07.792951 30015 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:30:07.793756 30015 webserver.cc:460] Webserver started at http://127.25.170.62:38619/ using document root <none> and password file <none>
I20260808 08:30:07.794291 30015 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:07.794377 30015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:07.794595 30015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:07.796630 30015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "c93e32d1a8c14976893dd9150363728a"
format_stamp: "Formatted at 2026-08-08 08:30:07 on dist-test-slave-zkpd"
server_key: "35725432d5bb9cf1436f3b2567f9f073"
server_key_iv: "697ee441039af02dedacc6ce5d0495a8"
server_key_version: "encryptionkey@0"
I20260808 08:30:07.797195 30015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "c93e32d1a8c14976893dd9150363728a"
format_stamp: "Formatted at 2026-08-08 08:30:07 on dist-test-slave-zkpd"
server_key: "35725432d5bb9cf1436f3b2567f9f073"
server_key_iv: "697ee441039af02dedacc6ce5d0495a8"
server_key_version: "encryptionkey@0"
I20260808 08:30:07.800688 30015 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:30:07.802889 30031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:07.804066 30015 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:07.804193 30015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "c93e32d1a8c14976893dd9150363728a"
format_stamp: "Formatted at 2026-08-08 08:30:07 on dist-test-slave-zkpd"
server_key: "35725432d5bb9cf1436f3b2567f9f073"
server_key_iv: "697ee441039af02dedacc6ce5d0495a8"
server_key_version: "encryptionkey@0"
I20260808 08:30:07.804298 30015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:07.819644 30015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:07.822743 30015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:07.822945 30015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:07.829851 30015 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:40075
I20260808 08:30:07.829878 30086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:40075 every 8 connection(s)
I20260808 08:30:07.830720 30015 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:07.832020 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 30015
I20260808 08:30:07.832157 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:07.832479 26280 external_mini_cluster.cc:1428] Setting key 1f587e18ff91b6db6945110f4dd3da59
I20260808 08:30:07.833783 30087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:07.840538 30087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a: Bootstrap starting.
Aug 08 08:30:07 dist-test-slave-zkpd krb5kdc[30002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:07.843156 30087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:07.844118 30087 log.cc:824] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:07.846426 30087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a: No bootstrap required, opened a new log
I20260808 08:30:07.847285 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:07.833872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40752 (local address 127.25.170.62:40075)
0808 08:30:07.834296 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:07.834311 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:07.834346 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:30:07.835203 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:07.835228 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:07.835716 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:07.836055 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:07.836936 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:07.837915 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:07.839059 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:07.839500 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:07.839611 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:07.842270 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:07.842276 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:07.842291 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:07.842329 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:07.844320 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:07.844787 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:07.844791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:07.844795 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:07.844903 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:07.845190 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:07.845193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:07.845194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:07.845702 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:07.845888 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:07.846097 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 08:30:07.846390 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":131,"threads_started":1}
I20260808 08:30:07.850366 30087 raft_consensus.cc:348] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e32d1a8c14976893dd9150363728a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40075 } }
I20260808 08:30:07.850564 30087 raft_consensus.cc:374] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:07.850598 30087 raft_consensus.cc:729] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c93e32d1a8c14976893dd9150363728a, State: Initialized, Role: FOLLOWER
I20260808 08:30:07.851037 30087 consensus_queue.cc:260] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e32d1a8c14976893dd9150363728a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40075 } }
I20260808 08:30:07.851161 30087 raft_consensus.cc:388] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:07.851238 30087 raft_consensus.cc:482] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:07.851323 30087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:07.852186 30087 raft_consensus.cc:504] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e32d1a8c14976893dd9150363728a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40075 } }
I20260808 08:30:07.852517 30087 leader_election.cc:302] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c93e32d1a8c14976893dd9150363728a; no voters:
I20260808 08:30:07.852809 30087 leader_election.cc:288] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:07.852927 30092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:07.853170 30092 raft_consensus.cc:686] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [term 1 LEADER]: Becoming Leader. State: Replica: c93e32d1a8c14976893dd9150363728a, State: Running, Role: LEADER
I20260808 08:30:07.853478 30092 consensus_queue.cc:237] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e32d1a8c14976893dd9150363728a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40075 } }
I20260808 08:30:07.854001 30087 sys_catalog.cc:564] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:07.855065 30093 sys_catalog.cc:455] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c93e32d1a8c14976893dd9150363728a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e32d1a8c14976893dd9150363728a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40075 } } }
I20260808 08:30:07.855199 30093 sys_catalog.cc:458] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:07.855479 30094 sys_catalog.cc:455] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c93e32d1a8c14976893dd9150363728a. Latest consensus state: current_term: 1 leader_uuid: "c93e32d1a8c14976893dd9150363728a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e32d1a8c14976893dd9150363728a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40075 } } }
I20260808 08:30:07.855568 30094 sys_catalog.cc:458] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:07.855720 30101 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:07.858752 30101 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:07.864423 30101 catalog_manager.cc:1347] Generated new cluster ID: 3f3b84355e824007ac88e10d7fec054a
I20260808 08:30:07.864491 30101 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:07.890651 30101 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:07.891649 30101 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:07.897423 30101 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c93e32d1a8c14976893dd9150363728a: Generated new TSK 0
I20260808 08:30:07.898064 30101 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:30:07.936164 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40075
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:08.062974 30114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:08.063216 30114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:08.063300 30114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:08.067546 30114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:08.067610 30114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:08.067711 30114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:08.073556 30114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:08.074798 30114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:08.075870 30114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:08.085321 30119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:08.085335 30120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:08.085335 30122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:08.085458 30114 server_base.cc:1034] running on GCE node
I20260808 08:30:08.086014 30114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:08.086639 30114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:08.087832 30114 hybrid_clock.cc:648] HybridClock initialized: now 1786177808087812 us; error 32 us; skew 500 ppm
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177808, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:08.090626 30114 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:30:08.091442 30114 webserver.cc:460] Webserver started at http://127.25.170.1:44437/ using document root <none> and password file <none>
I20260808 08:30:08.092023 30114 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:08.092092 30114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:08.092258 30114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:08.094343 30114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "185930c943d04e908721625c7d5fb995"
format_stamp: "Formatted at 2026-08-08 08:30:08 on dist-test-slave-zkpd"
server_key: "52a60c31bc71e0e9d8bb43c3d2ceef26"
server_key_iv: "3bb332fec480b2b526ae8e7d56b54d67"
server_key_version: "encryptionkey@0"
I20260808 08:30:08.094871 30114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "185930c943d04e908721625c7d5fb995"
format_stamp: "Formatted at 2026-08-08 08:30:08 on dist-test-slave-zkpd"
server_key: "52a60c31bc71e0e9d8bb43c3d2ceef26"
server_key_iv: "3bb332fec480b2b526ae8e7d56b54d67"
server_key_version: "encryptionkey@0"
I20260808 08:30:08.098460 30114 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 08:30:08.100747 30129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:08.102003 30114 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:08.102128 30114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "185930c943d04e908721625c7d5fb995"
format_stamp: "Formatted at 2026-08-08 08:30:08 on dist-test-slave-zkpd"
server_key: "52a60c31bc71e0e9d8bb43c3d2ceef26"
server_key_iv: "3bb332fec480b2b526ae8e7d56b54d67"
server_key_version: "encryptionkey@0"
I20260808 08:30:08.102224 30114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:08.113690 30114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:08.116590 30114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:08.116784 30114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:08.117357 30114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:08.118151 30114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:08.118206 30114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:08.118288 30114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:08.118319 30114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:08.127146 30114 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:43981
I20260808 08:30:08.127187 30246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:43981 every 8 connection(s)
I20260808 08:30:08.128028 30114 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:08.133074 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 30114
I20260808 08:30:08.133211 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:08.133486 26280 external_mini_cluster.cc:1428] Setting key 788c261b965bcac3f29169e9f8e4c50c
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177808, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:08.142577 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:08.129764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:50241 (local address 127.25.170.62:40075)
0808 08:30:08.129932 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:08.129936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:08.130739 (+ 803us) server_negotiation.cc:407] Connection header received
0808 08:30:08.132425 (+ 1686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:08.132428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:08.132475 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:08.132550 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:08.133843 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.134402 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.135755 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.136193 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.136330 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:08.138961 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:08.138965 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:08.138967 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:08.138990 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:08.140566 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:08.141093 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:08.141096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:08.141098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:08.141193 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:08.141519 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:08.141523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:08.141524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:08.141700 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:08.141804 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:08.142269 (+ 465us) server_negotiation.cc:299] Negotiation successful
0808 08:30:08.142407 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:30:08.143301 30249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:08.130128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40075 (local address 127.25.170.1:50241)
0808 08:30:08.130588 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:08.130634 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:08.132228 (+ 1594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:08.132713 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:08.132719 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:08.133083 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:08.133674 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:08.133689 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.134526 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.134530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:08.135617 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:08.135628 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.136342 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.136345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:08.136488 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:08.137086 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:08.137102 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:08.138792 (+ 1690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:08.140700 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:08.140706 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:08.140720 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:08.140988 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:08.141282 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:08.141286 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:08.141288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:08.141426 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:08.141810 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:08.141819 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:08.142052 (+ 233us) client_negotiation.cc:769] Sending connection context
0808 08:30:08.142228 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 08:30:08.142528 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":119,"threads_started":1}
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
I20260808 08:30:08.144567 30247 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40075
I20260808 08:30:08.144814 30247 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:08.145295 30247 heartbeater.cc:511] Master 127.25.170.62:40075 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:30:08.146886 30048 ts_manager.cc:194] Registered new tserver with Master: 185930c943d04e908721625c7d5fb995 (127.25.170.1:43981)
I20260808 08:30:08.148099 30048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:50241
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:30:08.163223 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40075
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:08.279246 30252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:08.279488 30252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:08.279565 30252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:08.283577 30252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:08.283631 30252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:08.283735 30252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:08.289502 30252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:08.290482 30252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:08.291484 30252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:08.301044 30258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:08.301009 30257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:08.301206 30252 server_base.cc:1034] running on GCE node
W20260808 08:30:08.301327 30260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:08.301839 30252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:08.302459 30252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:08.303633 30252 hybrid_clock.cc:648] HybridClock initialized: now 1786177808303621 us; error 30 us; skew 500 ppm
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177808, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:08.306465 30252 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:30:08.307343 30252 webserver.cc:460] Webserver started at http://127.25.170.2:41797/ using document root <none> and password file <none>
I20260808 08:30:08.307942 30252 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:08.308030 30252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:08.308291 30252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:08.310235 30252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "1eab8e0685f44fe28567e21c411669df"
format_stamp: "Formatted at 2026-08-08 08:30:08 on dist-test-slave-zkpd"
server_key: "dfe7a0efcfb40ceed80ef52bfd9eb798"
server_key_iv: "b4e6fa6a0b647fbfdffeac3fbd63529f"
server_key_version: "encryptionkey@0"
I20260808 08:30:08.310793 30252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "1eab8e0685f44fe28567e21c411669df"
format_stamp: "Formatted at 2026-08-08 08:30:08 on dist-test-slave-zkpd"
server_key: "dfe7a0efcfb40ceed80ef52bfd9eb798"
server_key_iv: "b4e6fa6a0b647fbfdffeac3fbd63529f"
server_key_version: "encryptionkey@0"
I20260808 08:30:08.314365 30252 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:30:08.316677 30267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:08.317830 30252 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:08.317955 30252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "1eab8e0685f44fe28567e21c411669df"
format_stamp: "Formatted at 2026-08-08 08:30:08 on dist-test-slave-zkpd"
server_key: "dfe7a0efcfb40ceed80ef52bfd9eb798"
server_key_iv: "b4e6fa6a0b647fbfdffeac3fbd63529f"
server_key_version: "encryptionkey@0"
I20260808 08:30:08.318056 30252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:08.340766 30252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:08.343631 30252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:08.343837 30252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:08.344427 30252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:08.345242 30252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:08.345309 30252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:08.345377 30252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:08.345423 30252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:08.354444 30252 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:38663
I20260808 08:30:08.354475 30383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:38663 every 8 connection(s)
I20260808 08:30:08.355378 30252 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:08.360129 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 30252
I20260808 08:30:08.360242 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:08.360515 26280 external_mini_cluster.cc:1428] Setting key f5cd8ac5e59e26c4f224df01d7b49db2
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177808, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:08.369984 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:08.357190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:38229 (local address 127.25.170.62:40075)
0808 08:30:08.357346 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:08.357351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:08.358164 (+ 813us) server_negotiation.cc:407] Connection header received
0808 08:30:08.359622 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:08.359624 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:08.359670 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:08.359744 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:08.361013 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.361750 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.362876 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.363100 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.363201 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:08.365857 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:08.365864 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:08.365870 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:08.365903 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:08.367676 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:08.368219 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:08.368224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:08.368229 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:08.368333 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:08.368679 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:08.368685 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:08.368688 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:08.368952 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:08.369054 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:08.369601 (+ 547us) server_negotiation.cc:299] Negotiation successful
0808 08:30:08.369764 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:30:08.370663 30386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:08.357581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40075 (local address 127.25.170.2:38229)
0808 08:30:08.358022 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:08.358063 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:08.359437 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:08.359946 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:08.359954 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:08.360377 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:08.360876 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:08.360889 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.361883 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.361886 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:08.362750 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:08.362759 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.363240 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.363244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:08.363404 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:08.364030 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:08.364055 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:08.365686 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:08.367791 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:08.367796 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:08.367806 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:08.368120 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:08.368432 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:08.368435 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:08.368436 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:08.368575 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:08.369059 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:08.369064 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:08.369306 (+ 242us) client_negotiation.cc:769] Sending connection context
0808 08:30:08.369504 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 08:30:08.369756 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:30:08.371840 30384 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40075
I20260808 08:30:08.372092 30384 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:08.372617 30384 heartbeater.cc:511] Master 127.25.170.62:40075 requested a full tablet report, sending...
I20260808 08:30:08.373620 30048 ts_manager.cc:194] Registered new tserver with Master: 1eab8e0685f44fe28567e21c411669df (127.25.170.2:38663)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
I20260808 08:30:08.374354 30048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:38229
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:30:08.390112 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40075
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:08.501595 30390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:08.501820 30390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:08.501868 30390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:08.505921 30390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:08.505970 30390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:08.506022 30390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:08.511191 30390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:08.512154 30390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:08.513098 30390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:08.522749 30398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:08.522737 30395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:08.522919 30390 server_base.cc:1034] running on GCE node
W20260808 08:30:08.522737 30396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:08.523378 30390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:08.524081 30390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:08.525249 30390 hybrid_clock.cc:648] HybridClock initialized: now 1786177808525229 us; error 29 us; skew 500 ppm
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177808, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:08.528062 30390 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:30:08.528841 30390 webserver.cc:460] Webserver started at http://127.25.170.3:35183/ using document root <none> and password file <none>
I20260808 08:30:08.529333 30390 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:08.529389 30390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:08.529549 30390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:08.531489 30390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "c9da77ad38fb437cbca46bc7a18e509b"
format_stamp: "Formatted at 2026-08-08 08:30:08 on dist-test-slave-zkpd"
server_key: "908bb6b86ee616b49a2a09beda907611"
server_key_iv: "179d5f36a462c788d8acd480e43f5394"
server_key_version: "encryptionkey@0"
I20260808 08:30:08.532048 30390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "c9da77ad38fb437cbca46bc7a18e509b"
format_stamp: "Formatted at 2026-08-08 08:30:08 on dist-test-slave-zkpd"
server_key: "908bb6b86ee616b49a2a09beda907611"
server_key_iv: "179d5f36a462c788d8acd480e43f5394"
server_key_version: "encryptionkey@0"
I20260808 08:30:08.535563 30390 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:30:08.537940 30405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:08.539069 30390 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:08.539186 30390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "c9da77ad38fb437cbca46bc7a18e509b"
format_stamp: "Formatted at 2026-08-08 08:30:08 on dist-test-slave-zkpd"
server_key: "908bb6b86ee616b49a2a09beda907611"
server_key_iv: "179d5f36a462c788d8acd480e43f5394"
server_key_version: "encryptionkey@0"
I20260808 08:30:08.539283 30390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:08.573406 30390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:08.576683 30390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:08.576898 30390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:08.577569 30390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:08.578464 30390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:08.578514 30390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:08.578583 30390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:08.578629 30390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:08.588410 30390 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:37375
I20260808 08:30:08.588418 30518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:37375 every 8 connection(s)
I20260808 08:30:08.589351 30390 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:08.596768 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 30390
I20260808 08:30:08.596930 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:08.597239 26280 external_mini_cluster.cc:1428] Setting key baa19c9244cc3c9eb0002394f0ba5c3b
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177808, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:08.602960 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:08.591350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:55941 (local address 127.25.170.62:40075)
0808 08:30:08.591483 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:08.591487 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:08.592400 (+ 913us) server_negotiation.cc:407] Connection header received
0808 08:30:08.593830 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:08.593834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:08.593889 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:08.593994 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:08.595124 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.595643 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.596893 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.597164 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.597281 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:08.599827 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:08.599830 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:08.599832 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:08.599856 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:08.601226 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:08.601696 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:08.601698 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:08.601699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:08.601775 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:08.602068 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:08.602070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:08.602071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:08.602240 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:08.602329 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:08.602746 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 08:30:08.602842 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:30:08.603741 30521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:08.591743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40075 (local address 127.25.170.3:55941)
0808 08:30:08.592261 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:08.592304 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:08.593589 (+ 1285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:08.594165 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:08.594171 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:08.594510 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:08.594985 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:08.594999 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.595819 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.595822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:08.596755 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:08.596767 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.597324 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.597328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:08.597490 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:08.598062 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:08.598078 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:08.599667 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:08.601333 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:08.601337 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:08.601349 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:08.601603 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:08.601856 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:08.601858 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:08.601859 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:08.601987 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:08.602336 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:08.602341 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:08.602555 (+ 214us) client_negotiation.cc:769] Sending connection context
0808 08:30:08.602704 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 08:30:08.602953 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":182,"threads_started":1}
I20260808 08:30:08.604882 30519 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40075
I20260808 08:30:08.605093 30519 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:08.605517 30519 heartbeater.cc:511] Master 127.25.170.62:40075 requested a full tablet report, sending...
I20260808 08:30:08.606513 30048 ts_manager.cc:194] Registered new tserver with Master: c9da77ad38fb437cbca46bc7a18e509b (127.25.170.3:37375)
I20260808 08:30:08.607085 30048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:55941
I20260808 08:30:08.610915 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:30:08.637140 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:08.628017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51754 (local address 127.25.170.1:43981)
0808 08:30:08.628356 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:08.628370 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:08.628393 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:30:08.628442 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:08.628447 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:08.628626 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:08.628744 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:08.629526 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.630275 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.631113 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.631473 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.631554 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:08.633817 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:08.633826 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:08.633839 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:08.633865 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:08.635458 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:08.635831 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:08.635836 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:08.635837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:08.635998 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:08.636236 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:08.636238 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:08.636239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:08.636476 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:08.636623 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:08.636774 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 08:30:08.636934 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":129,"threads_started":1}
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:08.647413 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:08.639758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40754 (local address 127.25.170.62:40075)
0808 08:30:08.639974 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:08.639979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:08.639999 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:30:08.640036 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:08.640038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:08.640075 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:08.640137 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:08.640643 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.641119 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.641855 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:08.642055 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:08.642127 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:08.644383 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:08.644385 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:08.644387 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:08.644410 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:08.645634 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:08.646019 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:08.646022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:08.646023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:08.646090 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:08.646333 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:08.646338 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:08.646341 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:08.646632 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:08.646770 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:08.647072 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 08:30:08.647212 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 08:30:08.647927 30048 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40754
I20260808 08:30:08.648509 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 30114
I20260808 08:30:08.659971 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 30252
I20260808 08:30:08.668576 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 30390
I20260808 08:30:08.676388 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 30015
2026-08-08T08:30:08Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2228 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30532](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30532](info): set up 2 sockets
Aug 08 08:30:08 dist-test-slave-zkpd krb5kdc[30532](info): commencing operation
krb5kdc: starting...
W20260808 08:30:09.745337 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:09 dist-test-slave-zkpd krb5kdc[30532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:30:09.864090 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:43703
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:35163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:43703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:09.975728 30546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:09.976050 30546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:09.976126 30546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:09.980154 30546 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:09.980207 30546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:09.980226 30546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:09.980274 30546 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:09.980327 30546 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:09.985539 30546 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:35163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:43703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:43703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:09.986589 30546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:09.987624 30546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:09.995807 30551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:09.995839 30552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:09.995839 30555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:09.995916 30546 server_base.cc:1034] running on GCE node
I20260808 08:30:09.996619 30546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:09.997685 30546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:09.998875 30546 hybrid_clock.cc:648] HybridClock initialized: now 1786177809998853 us; error 38 us; skew 500 ppm
Aug 08 08:30:09 dist-test-slave-zkpd krb5kdc[30532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177809, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:10.001667 30546 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:30:10.002400 30546 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:10.002487 30546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:10.002705 30546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:10.004805 30546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "cf781bb3aa8e4bac9f6a31273099713e"
format_stamp: "Formatted at 2026-08-08 08:30:09 on dist-test-slave-zkpd"
server_key: "561eed7bb76160e182f4798abb958ff1"
server_key_iv: "6490fe1239e3bb5fad0bb97cdb1bbdfa"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.005384 30546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "cf781bb3aa8e4bac9f6a31273099713e"
format_stamp: "Formatted at 2026-08-08 08:30:09 on dist-test-slave-zkpd"
server_key: "561eed7bb76160e182f4798abb958ff1"
server_key_iv: "6490fe1239e3bb5fad0bb97cdb1bbdfa"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.009316 30546 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:30:10.011606 30562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:10.012849 30546 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:10.012986 30546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "cf781bb3aa8e4bac9f6a31273099713e"
format_stamp: "Formatted at 2026-08-08 08:30:09 on dist-test-slave-zkpd"
server_key: "561eed7bb76160e182f4798abb958ff1"
server_key_iv: "6490fe1239e3bb5fad0bb97cdb1bbdfa"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.013094 30546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:10.045653 30546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:10.048607 30546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:10.048808 30546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:10.056136 30546 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:43703
I20260808 08:30:10.056422 30617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:43703 every 8 connection(s)
I20260808 08:30:10.056819 30546 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:10.059566 30618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:10.060134 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 30546
I20260808 08:30:10.060278 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:10.060582 26280 external_mini_cluster.cc:1428] Setting key 7c34c7519d4b4acba8de53a091bfa5db
I20260808 08:30:10.066783 30618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e: Bootstrap starting.
I20260808 08:30:10.069576 30618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e: Neither blocks nor log segments found. Creating new log.
Aug 08 08:30:10 dist-test-slave-zkpd krb5kdc[30532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:10.070467 30618 log.cc:824] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:10.072815 30618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e: No bootstrap required, opened a new log
I20260808 08:30:10.075150 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.061888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54738 (local address 127.25.170.62:43703)
0808 08:30:10.062277 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.062292 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.062327 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:30:10.063007 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.063024 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.063343 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.063618 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:10.064599 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.065567 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.066764 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.067305 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.067428 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.070261 (+ 2833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:10.070266 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:10.070280 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:10.070307 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:10.072265 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:10.072769 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:10.072775 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:10.072781 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:10.072952 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:10.073244 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:10.073246 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:10.073247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:10.073625 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:10.073776 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.074121 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.074433 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":122,"threads_started":1}
I20260808 08:30:10.076815 30618 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf781bb3aa8e4bac9f6a31273099713e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43703 } }
I20260808 08:30:10.077051 30618 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:10.077147 30618 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf781bb3aa8e4bac9f6a31273099713e, State: Initialized, Role: FOLLOWER
I20260808 08:30:10.077591 30618 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf781bb3aa8e4bac9f6a31273099713e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43703 } }
I20260808 08:30:10.077737 30618 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:10.077821 30618 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:10.077936 30618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:10.078814 30618 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf781bb3aa8e4bac9f6a31273099713e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43703 } }
I20260808 08:30:10.079137 30618 leader_election.cc:302] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf781bb3aa8e4bac9f6a31273099713e; no voters:
I20260808 08:30:10.079428 30618 leader_election.cc:288] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:10.079545 30623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:10.079779 30623 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [term 1 LEADER]: Becoming Leader. State: Replica: cf781bb3aa8e4bac9f6a31273099713e, State: Running, Role: LEADER
I20260808 08:30:10.080128 30623 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf781bb3aa8e4bac9f6a31273099713e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43703 } }
I20260808 08:30:10.080597 30618 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:10.081653 30624 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf781bb3aa8e4bac9f6a31273099713e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf781bb3aa8e4bac9f6a31273099713e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43703 } } }
I20260808 08:30:10.081802 30624 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:10.081990 30625 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf781bb3aa8e4bac9f6a31273099713e. Latest consensus state: current_term: 1 leader_uuid: "cf781bb3aa8e4bac9f6a31273099713e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf781bb3aa8e4bac9f6a31273099713e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43703 } } }
I20260808 08:30:10.082155 30625 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:10.082976 30633 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:10.085618 30633 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:10.090786 30633 catalog_manager.cc:1347] Generated new cluster ID: 7549ae76b9014ad383b92a4d9161f6d9
I20260808 08:30:10.090862 30633 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:10.095667 30633 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:10.096585 30633 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:10.111124 30633 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e: Generated new TSK 0
I20260808 08:30:10.111981 30633 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:30:10.147038 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:43703
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:35163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:10.258922 30645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:10.259169 30645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:10.259217 30645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:10.263242 30645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:10.263300 30645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:10.263387 30645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:10.268589 30645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:35163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:43703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:10.269606 30645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:10.270627 30645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:10.280105 30651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:10.280114 30650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:10.280166 30654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:10.280272 30645 server_base.cc:1034] running on GCE node
I20260808 08:30:10.280810 30645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:10.281468 30645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:10.282634 30645 hybrid_clock.cc:648] HybridClock initialized: now 1786177810282600 us; error 42 us; skew 500 ppm
Aug 08 08:30:10 dist-test-slave-zkpd krb5kdc[30532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177810, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:10.285586 30645 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:30:10.286299 30645 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:10.286362 30645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:10.286568 30645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:10.288618 30645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "39a9b0cea43c42138125c231bd3c061b"
format_stamp: "Formatted at 2026-08-08 08:30:10 on dist-test-slave-zkpd"
server_key: "9becaccb8301a3ec135eb55dbc7beea9"
server_key_iv: "cc5648935dd4373e6d5e7c76f99bce22"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.289172 30645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "39a9b0cea43c42138125c231bd3c061b"
format_stamp: "Formatted at 2026-08-08 08:30:10 on dist-test-slave-zkpd"
server_key: "9becaccb8301a3ec135eb55dbc7beea9"
server_key_iv: "cc5648935dd4373e6d5e7c76f99bce22"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.292806 30645 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:30:10.295040 30660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:10.296275 30645 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:10.296396 30645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "39a9b0cea43c42138125c231bd3c061b"
format_stamp: "Formatted at 2026-08-08 08:30:10 on dist-test-slave-zkpd"
server_key: "9becaccb8301a3ec135eb55dbc7beea9"
server_key_iv: "cc5648935dd4373e6d5e7c76f99bce22"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.296495 30645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:10.315650 30645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:10.318863 30645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:10.319046 30645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:10.319579 30645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:10.320403 30645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:10.320469 30645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:10.320535 30645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:10.320582 30645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:10.329694 30645 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:46373
I20260808 08:30:10.329717 30778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:46373 every 8 connection(s)
I20260808 08:30:10.330260 30645 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:10.333372 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 30645
I20260808 08:30:10.333511 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:10.333814 26280 external_mini_cluster.cc:1428] Setting key b1c686e1a92b89c639749f779651c483
Aug 08 08:30:10 dist-test-slave-zkpd krb5kdc[30532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177810, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
I20260808 08:30:10.344973 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.331952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:40919 (local address 127.25.170.62:43703)
0808 08:30:10.332081 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.332085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.333305 (+ 1220us) server_negotiation.cc:407] Connection header received
0808 08:30:10.334465 (+ 1160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.334468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.334530 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.334620 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:10.336049 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.336567 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.338035 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.338427 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.338551 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.341347 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:10.341350 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:10.341352 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:10.341376 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:10.342774 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:10.343367 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:10.343369 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:10.343370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:10.343442 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:10.343848 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:10.343850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:10.343851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:10.344060 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:10.344136 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.344750 (+ 614us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.344851 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:30:10.345786 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.332309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:43703 (local address 127.25.170.1:40919)
0808 08:30:10.333139 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:10.333197 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:10.334251 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:10.334768 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:10.334774 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:10.335204 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:10.335879 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.335927 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.336690 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.336696 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.337916 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.337926 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.338575 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.338578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.338711 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.339328 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:10.339345 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:10.341174 (+ 1829us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:10.342898 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:10.342906 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:10.342921 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:10.343264 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:10.343533 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:10.343536 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:10.343538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:10.343731 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:10.344160 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:10.344166 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:10.344485 (+ 319us) client_negotiation.cc:769] Sending connection context
0808 08:30:10.344686 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 08:30:10.344935 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":123,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:30:10.347074 30779 heartbeater.cc:347] Connected to a master server at 127.25.170.62:43703
I20260808 08:30:10.347298 30779 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:10.347851 30779 heartbeater.cc:511] Master 127.25.170.62:43703 requested a full tablet report, sending...
I20260808 08:30:10.349351 30581 ts_manager.cc:194] Registered new tserver with Master: 39a9b0cea43c42138125c231bd3c061b (127.25.170.1:46373)
I20260808 08:30:10.350432 30581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:40919
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:30:10.362936 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:43703
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:35163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:10.473934 30785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:10.474205 30785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:10.474277 30785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:10.478195 30785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:10.478273 30785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:10.478363 30785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:10.483552 30785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:35163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:43703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:10.484543 30785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:10.485517 30785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:10.494508 30790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:10.494508 30791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:10.494557 30785 server_base.cc:1034] running on GCE node
W20260808 08:30:10.494573 30793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:10.495278 30785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:10.495828 30785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:10.496984 30785 hybrid_clock.cc:648] HybridClock initialized: now 1786177810496955 us; error 45 us; skew 500 ppm
Aug 08 08:30:10 dist-test-slave-zkpd krb5kdc[30532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177810, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:10.499827 30785 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:30:10.500583 30785 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:10.500644 30785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:10.500866 30785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:10.502821 30785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "7eab94af158440d1b8e40b06ba6b6abc"
format_stamp: "Formatted at 2026-08-08 08:30:10 on dist-test-slave-zkpd"
server_key: "298284c5979038f61d925a67af0f7023"
server_key_iv: "6ab741220a4bf3a7bcf4d5d032cfa750"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.503381 30785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "7eab94af158440d1b8e40b06ba6b6abc"
format_stamp: "Formatted at 2026-08-08 08:30:10 on dist-test-slave-zkpd"
server_key: "298284c5979038f61d925a67af0f7023"
server_key_iv: "6ab741220a4bf3a7bcf4d5d032cfa750"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.506916 30785 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:30:10.509281 30799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:10.510455 30785 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:10.510591 30785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "7eab94af158440d1b8e40b06ba6b6abc"
format_stamp: "Formatted at 2026-08-08 08:30:10 on dist-test-slave-zkpd"
server_key: "298284c5979038f61d925a67af0f7023"
server_key_iv: "6ab741220a4bf3a7bcf4d5d032cfa750"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.510690 30785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:10.546671 30785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:10.549845 30785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:10.550045 30785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:10.550657 30785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:10.551515 30785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:10.551584 30785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:10.551657 30785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:10.551697 30785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:10.560948 30785 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:40039
I20260808 08:30:10.560981 30915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:40039 every 8 connection(s)
I20260808 08:30:10.561535 30785 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:10.569149 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 30785
I20260808 08:30:10.569298 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:10.569657 26280 external_mini_cluster.cc:1428] Setting key 03a8aeefbdba12dc37b8704d85255a09
Aug 08 08:30:10 dist-test-slave-zkpd krb5kdc[30532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177810, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:10.575455 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.563259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:32925 (local address 127.25.170.62:43703)
0808 08:30:10.563391 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.563395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.564622 (+ 1227us) server_negotiation.cc:407] Connection header received
0808 08:30:10.565486 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.565490 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.565546 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.565645 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:10.566799 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.567335 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.568484 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.568714 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.568822 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.571437 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:10.571443 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:10.571449 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:10.571482 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:10.573007 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:10.573543 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:10.573549 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:10.573554 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:10.573671 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:10.574020 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:10.574025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:10.574027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:10.574286 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:10.574421 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.575065 (+ 644us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.575204 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:30:10.576138 30918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.563610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:43703 (local address 127.25.170.2:32925)
0808 08:30:10.564476 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:10.564515 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:10.565290 (+ 775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:10.565845 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:10.565851 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:10.566192 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:10.566646 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.566659 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.567459 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.567462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.568353 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.568362 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.568863 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.568867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.569040 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.569608 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:10.569629 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:10.571231 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:10.573147 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:10.573156 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:10.573174 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:10.573449 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:10.573783 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:10.573786 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:10.573788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:10.573929 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:10.574432 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:10.574440 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:10.574771 (+ 331us) client_negotiation.cc:769] Sending connection context
0808 08:30:10.574979 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 08:30:10.575221 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":116,"threads_started":1}
I20260808 08:30:10.577306 30916 heartbeater.cc:347] Connected to a master server at 127.25.170.62:43703
I20260808 08:30:10.577567 30916 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:10.578116 30916 heartbeater.cc:511] Master 127.25.170.62:43703 requested a full tablet report, sending...
I20260808 08:30:10.579231 30581 ts_manager.cc:194] Registered new tserver with Master: 7eab94af158440d1b8e40b06ba6b6abc (127.25.170.2:40039)
I20260808 08:30:10.580102 30581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:32925
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:30:10.596882 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:43703
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:35163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:10.707857 30921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:10.708148 30921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:10.708226 30921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:10.712090 30921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:10.712157 30921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:10.712244 30921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:10.717419 30921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:35163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:43703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:10.718325 30921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:10.719255 30921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:10.728297 30929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:10.728331 30926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:10.728309 30927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:10.728649 30921 server_base.cc:1034] running on GCE node
I20260808 08:30:10.729167 30921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:10.729874 30921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:10.731055 30921 hybrid_clock.cc:648] HybridClock initialized: now 1786177810731038 us; error 31 us; skew 500 ppm
Aug 08 08:30:10 dist-test-slave-zkpd krb5kdc[30532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177810, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:10.734151 30921 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:30:10.734972 30921 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:10.735044 30921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:10.735306 30921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:10.737509 30921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "e668266b3dce40799c14e073c154e64d"
format_stamp: "Formatted at 2026-08-08 08:30:10 on dist-test-slave-zkpd"
server_key: "8b42e3a0d644d3f5b872d898c3c9c848"
server_key_iv: "b3b09d901862da7a1cb18de391028302"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.738111 30921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "e668266b3dce40799c14e073c154e64d"
format_stamp: "Formatted at 2026-08-08 08:30:10 on dist-test-slave-zkpd"
server_key: "8b42e3a0d644d3f5b872d898c3c9c848"
server_key_iv: "b3b09d901862da7a1cb18de391028302"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.742070 30921 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:30:10.744379 30935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:10.745534 30921 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:10.745663 30921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "e668266b3dce40799c14e073c154e64d"
format_stamp: "Formatted at 2026-08-08 08:30:10 on dist-test-slave-zkpd"
server_key: "8b42e3a0d644d3f5b872d898c3c9c848"
server_key_iv: "b3b09d901862da7a1cb18de391028302"
server_key_version: "encryptionkey@0"
I20260808 08:30:10.745772 30921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:10.768067 30921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:10.771337 30921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:10.771543 30921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:10.772279 30921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:10.773161 30921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:10.773229 30921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:10.773291 30921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:10.773322 30921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:10.782802 30921 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:36761
I20260808 08:30:10.782820 31052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:36761 every 8 connection(s)
I20260808 08:30:10.783398 30921 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
Aug 08 08:30:10 dist-test-slave-zkpd krb5kdc[30532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177810, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:10.793354 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 30921
I20260808 08:30:10.793509 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:10.793800 26280 external_mini_cluster.cc:1428] Setting key a168c98afc6ef9df9258f2b2e9e3e262
I20260808 08:30:10.796672 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.785166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:44853 (local address 127.25.170.62:43703)
0808 08:30:10.785310 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.785315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.786474 (+ 1159us) server_negotiation.cc:407] Connection header received
0808 08:30:10.787340 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.787342 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.787389 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.787464 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:10.788680 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.789205 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.790305 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.790519 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.790599 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.792955 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:10.792958 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:10.792960 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:10.792983 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:10.794716 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:10.795179 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:10.795183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:10.795185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:10.795276 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:10.795606 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:10.795611 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:10.795613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:10.795795 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:10.795897 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.796388 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.796507 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:30:10.797410 31055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.785562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:43703 (local address 127.25.170.3:44853)
0808 08:30:10.786338 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:10.786379 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:10.787146 (+ 767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:10.787628 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:10.787634 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:10.788054 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:10.788539 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.788553 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.789327 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.789330 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.790194 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.790203 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.790645 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.790647 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.790785 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.791307 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:10.791323 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:10.792779 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:10.794807 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:10.794813 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:10.794826 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:10.795073 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:10.795373 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:10.795375 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:10.795378 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:10.795512 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:10.795923 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:10.795931 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:10.796157 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 08:30:10.796331 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 08:30:10.796645 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":109,"threads_started":1}
I20260808 08:30:10.798422 31053 heartbeater.cc:347] Connected to a master server at 127.25.170.62:43703
I20260808 08:30:10.798655 31053 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:10.799129 31053 heartbeater.cc:511] Master 127.25.170.62:43703 requested a full tablet report, sending...
I20260808 08:30:10.800127 30581 ts_manager.cc:194] Registered new tserver with Master: e668266b3dce40799c14e073c154e64d (127.25.170.3:36761)
I20260808 08:30:10.800678 30581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:44853
I20260808 08:30:10.807322 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:30:10.816278 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.809181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37544 (local address 127.25.170.62:43703)
0808 08:30:10.809284 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.809288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.809453 (+ 165us) server_negotiation.cc:407] Connection header received
0808 08:30:10.809544 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.809545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.809579 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.809644 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:10.810383 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.810854 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.811602 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.811798 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.811871 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.813383 (+ 1512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:10.813385 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:10.813387 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:10.813405 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:10.814817 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:10.815209 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:10.815212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:10.815213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:10.815282 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:10.815528 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:10.815530 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:10.815531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:10.815716 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:10.815818 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.816061 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.816149 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 08:30:10.818799 30581 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:30:10.821766 30581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:30:10.835995 31064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.829681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:36761 (local address 127.0.0.1:32952)
0808 08:30:10.829984 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:10.830157 (+ 173us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:10.830285 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:10.831438 (+ 1153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:10.831444 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:10.831484 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:10.831667 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.831674 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.833300 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.833304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.834646 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.834655 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.835437 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.835441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.835548 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.835584 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:30:10.835711 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 08:30:10.835828 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":70,"spinlock_wait_cycles":5888,"thread_start_us":89,"threads_started":1}
I20260808 08:30:10.836027 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.829781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32952 (local address 127.25.170.3:36761)
0808 08:30:10.830956 (+ 1175us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.830971 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.830998 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:30:10.831086 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.831093 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.831288 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.831445 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:10.831794 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.833115 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.834762 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.835308 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.835433 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.835576 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.835748 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.835864 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1076,"thread_start_us":155,"threads_started":1}
I20260808 08:30:10.836615 31065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.830460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:46373 (local address 127.0.0.1:47134)
0808 08:30:10.831674 (+ 1214us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:10.831688 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:10.831800 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:10.832285 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:10.832288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:10.832307 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:10.832395 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.832401 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.833716 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.833719 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.834894 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.834905 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.836214 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.836217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.836321 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.836344 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:30:10.836413 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 08:30:10.836478 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1155,"mutex_wait_us":24,"thread_start_us":105,"threads_started":1}
I20260808 08:30:10.837039 31067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.829764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:40039 (local address 127.0.0.1:55968)
0808 08:30:10.830819 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:10.830834 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:10.830924 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:10.831440 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:10.831445 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:10.831488 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:10.831667 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.831675 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.832896 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.832901 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.835335 (+ 2434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.835345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.836628 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.836634 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.836732 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.836769 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:30:10.836853 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 08:30:10.836919 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":992,"mutex_wait_us":79,"spinlock_wait_cycles":6528,"thread_start_us":119,"threads_started":1}
I20260808 08:30:10.837141 31069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.830637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47134 (local address 127.25.170.1:46373)
0808 08:30:10.831060 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.831066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.831843 (+ 777us) server_negotiation.cc:407] Connection header received
0808 08:30:10.831957 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.831962 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.832133 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.832278 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:10.832517 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.833568 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.835033 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.835846 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.836016 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.836156 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.836886 (+ 730us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.836979 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":144,"threads_started":1}
I20260808 08:30:10.837568 31068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.830450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55968 (local address 127.25.170.2:40039)
0808 08:30:10.831019 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.831031 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.831055 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:30:10.831138 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.831142 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.831288 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.831441 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:10.831848 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.832768 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.835475 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.836329 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.836437 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.836564 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.837317 (+ 753us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.837422 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":121,"threads_started":1}
I20260808 08:30:10.839530 30709 tablet_service.cc:1467] Processing CreateTablet for tablet 85b8a5c8c8b047ceb10c5748280321a9 (DEFAULT_TABLE table=test-table [id=a0c4ecb4b52d451987d9aaf903d18f95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:10.839475 30984 tablet_service.cc:1467] Processing CreateTablet for tablet 85b8a5c8c8b047ceb10c5748280321a9 (DEFAULT_TABLE table=test-table [id=a0c4ecb4b52d451987d9aaf903d18f95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:10.840152 30847 tablet_service.cc:1467] Processing CreateTablet for tablet 85b8a5c8c8b047ceb10c5748280321a9 (DEFAULT_TABLE table=test-table [id=a0c4ecb4b52d451987d9aaf903d18f95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:10.840607 30709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85b8a5c8c8b047ceb10c5748280321a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:10.840621 30984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85b8a5c8c8b047ceb10c5748280321a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:10.841041 30847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85b8a5c8c8b047ceb10c5748280321a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:10.846661 31070 tablet_bootstrap.cc:492] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b: Bootstrap starting.
I20260808 08:30:10.848325 31071 tablet_bootstrap.cc:492] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: Bootstrap starting.
I20260808 08:30:10.848922 31070 tablet_bootstrap.cc:654] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:10.849344 31072 tablet_bootstrap.cc:492] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: Bootstrap starting.
I20260808 08:30:10.849748 31070 log.cc:824] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:10.851289 31071 tablet_bootstrap.cc:654] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:10.851694 31070 tablet_bootstrap.cc:492] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b: No bootstrap required, opened a new log
I20260808 08:30:10.851877 31070 ts_tablet_manager.cc:1397] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:30:10.852349 31071 log.cc:824] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:10.853681 31072 tablet_bootstrap.cc:654] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:10.854370 31071 tablet_bootstrap.cc:492] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: No bootstrap required, opened a new log
I20260808 08:30:10.854557 31071 ts_tablet_manager.cc:1397] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260808 08:30:10.854715 31072 log.cc:824] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:10.856324 31072 tablet_bootstrap.cc:492] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: No bootstrap required, opened a new log
I20260808 08:30:10.856164 31070 raft_consensus.cc:348] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 } } peers { permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 } } peers { permanent_uuid: "39a9b0cea43c42138125c231bd3c061b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46373 } }
I20260808 08:30:10.856446 31070 raft_consensus.cc:374] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:10.856511 31072 ts_tablet_manager.cc:1397] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 08:30:10.856511 31070 raft_consensus.cc:729] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a9b0cea43c42138125c231bd3c061b, State: Initialized, Role: FOLLOWER
I20260808 08:30:10.856983 31070 consensus_queue.cc:260] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 } } peers { permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 } } peers { permanent_uuid: "39a9b0cea43c42138125c231bd3c061b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46373 } }
I20260808 08:30:10.857674 30779 heartbeater.cc:503] Master 127.25.170.62:43703 was elected leader, sending a full tablet report...
I20260808 08:30:10.858038 31070 ts_tablet_manager.cc:1428] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260808 08:30:10.859133 31071 raft_consensus.cc:348] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 } } peers { permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 } } peers { permanent_uuid: "39a9b0cea43c42138125c231bd3c061b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46373 } }
I20260808 08:30:10.859400 31071 raft_consensus.cc:374] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:10.859467 31071 raft_consensus.cc:729] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eab94af158440d1b8e40b06ba6b6abc, State: Initialized, Role: FOLLOWER
I20260808 08:30:10.859974 31071 consensus_queue.cc:260] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 } } peers { permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 } } peers { permanent_uuid: "39a9b0cea43c42138125c231bd3c061b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46373 } }
I20260808 08:30:10.860023 31072 raft_consensus.cc:348] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 } } peers { permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 } } peers { permanent_uuid: "39a9b0cea43c42138125c231bd3c061b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46373 } }
I20260808 08:30:10.860297 31072 raft_consensus.cc:374] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:10.860366 31072 raft_consensus.cc:729] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e668266b3dce40799c14e073c154e64d, State: Initialized, Role: FOLLOWER
I20260808 08:30:10.860780 31072 consensus_queue.cc:260] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 } } peers { permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 } } peers { permanent_uuid: "39a9b0cea43c42138125c231bd3c061b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46373 } }
I20260808 08:30:10.860975 31071 ts_tablet_manager.cc:1428] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:30:10.861315 30916 heartbeater.cc:503] Master 127.25.170.62:43703 was elected leader, sending a full tablet report...
I20260808 08:30:10.861413 31053 heartbeater.cc:503] Master 127.25.170.62:43703 was elected leader, sending a full tablet report...
I20260808 08:30:10.862617 31072 ts_tablet_manager.cc:1428] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:30:10.884727 31076 raft_consensus.cc:482] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:10.884878 31076 raft_consensus.cc:504] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 } } peers { permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 } } peers { permanent_uuid: "39a9b0cea43c42138125c231bd3c061b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46373 } }
I20260808 08:30:10.885861 31076 leader_election.cc:288] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e668266b3dce40799c14e073c154e64d (127.25.170.3:36761), 7eab94af158440d1b8e40b06ba6b6abc (127.25.170.2:40039)
I20260808 08:30:10.890489 31068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.886284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:48063 (local address 127.25.170.2:40039)
0808 08:30:10.886418 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.886423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.886602 (+ 179us) server_negotiation.cc:407] Connection header received
0808 08:30:10.886762 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.886765 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.886806 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.886886 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:10.887170 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.887676 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.889558 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.889977 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.890074 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.890116 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.890300 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.890384 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:30:10.890518 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.886090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:40039 (local address 127.25.170.1:48063)
0808 08:30:10.886499 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:10.886511 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:10.886642 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:10.886898 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:10.886901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:10.886917 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:10.887058 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.887064 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.887811 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.887816 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.889438 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.889450 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.890092 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.890095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.890167 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.890189 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:30:10.890278 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 08:30:10.890353 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":140,"thread_start_us":130,"threads_started":1}
I20260808 08:30:10.891076 30869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b8a5c8c8b047ceb10c5748280321a9" candidate_uuid: "39a9b0cea43c42138125c231bd3c061b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eab94af158440d1b8e40b06ba6b6abc" is_pre_election: true
I20260808 08:30:10.891201 31080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.886090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:36761 (local address 127.25.170.1:36661)
0808 08:30:10.886612 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:10.886624 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:10.886745 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:10.887007 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:10.887009 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:10.887026 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:10.887143 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.887148 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.887843 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.887847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.889441 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:10.889450 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.890876 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.890880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:10.890972 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.890989 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 08:30:10.891050 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 08:30:10.891099 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"mutex_wait_us":240,"thread_start_us":120,"threads_started":1}
I20260808 08:30:10.891297 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.886223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:36661 (local address 127.25.170.3:36761)
0808 08:30:10.886371 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.886376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.886702 (+ 326us) server_negotiation.cc:407] Connection header received
0808 08:30:10.886843 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.886845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.886916 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.886995 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:10.887248 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.887736 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.890185 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.890629 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.890746 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.890812 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.891104 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.891187 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:30:10.891400 30869 raft_consensus.cc:2454] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a9b0cea43c42138125c231bd3c061b in term 0.
I20260808 08:30:10.891952 30663 leader_election.cc:302] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a9b0cea43c42138125c231bd3c061b, 7eab94af158440d1b8e40b06ba6b6abc; no voters:
I20260808 08:30:10.892110 31004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b8a5c8c8b047ceb10c5748280321a9" candidate_uuid: "39a9b0cea43c42138125c231bd3c061b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e668266b3dce40799c14e073c154e64d" is_pre_election: true
I20260808 08:30:10.892233 31076 raft_consensus.cc:2781] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:30:10.892328 31076 raft_consensus.cc:482] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:30:10.892382 31076 raft_consensus.cc:3037] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:10.892421 31004 raft_consensus.cc:2454] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a9b0cea43c42138125c231bd3c061b in term 0.
I20260808 08:30:10.893559 31076 raft_consensus.cc:504] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 } } peers { permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 } } peers { permanent_uuid: "39a9b0cea43c42138125c231bd3c061b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46373 } }
I20260808 08:30:10.893903 31076 leader_election.cc:288] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [CANDIDATE]: Term 1 election: Requested vote from peers e668266b3dce40799c14e073c154e64d (127.25.170.3:36761), 7eab94af158440d1b8e40b06ba6b6abc (127.25.170.2:40039)
I20260808 08:30:10.894205 31004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b8a5c8c8b047ceb10c5748280321a9" candidate_uuid: "39a9b0cea43c42138125c231bd3c061b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e668266b3dce40799c14e073c154e64d"
I20260808 08:30:10.894253 30869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b8a5c8c8b047ceb10c5748280321a9" candidate_uuid: "39a9b0cea43c42138125c231bd3c061b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eab94af158440d1b8e40b06ba6b6abc"
I20260808 08:30:10.894343 31004 raft_consensus.cc:3037] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:10.894354 30869 raft_consensus.cc:3037] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:10.895664 30869 raft_consensus.cc:2454] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a9b0cea43c42138125c231bd3c061b in term 1.
I20260808 08:30:10.895676 31004 raft_consensus.cc:2454] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a9b0cea43c42138125c231bd3c061b in term 1.
I20260808 08:30:10.895982 30663 leader_election.cc:302] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a9b0cea43c42138125c231bd3c061b, 7eab94af158440d1b8e40b06ba6b6abc; no voters:
I20260808 08:30:10.896164 31076 raft_consensus.cc:2781] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:10.896399 31076 raft_consensus.cc:686] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [term 1 LEADER]: Becoming Leader. State: Replica: 39a9b0cea43c42138125c231bd3c061b, State: Running, Role: LEADER
I20260808 08:30:10.896735 31076 consensus_queue.cc:237] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 } } peers { permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 } } peers { permanent_uuid: "39a9b0cea43c42138125c231bd3c061b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46373 } }
I20260808 08:30:10.899839 30581 catalog_manager.cc:5495] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a9b0cea43c42138125c231bd3c061b (127.25.170.1). New cstate: current_term: 1 leader_uuid: "39a9b0cea43c42138125c231bd3c061b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a9b0cea43c42138125c231bd3c061b" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46373 } health_report { overall_health: HEALTHY } } }
I20260808 08:30:10.911301 31069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.907983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47144 (local address 127.25.170.1:46373)
0808 08:30:10.908106 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:10.908109 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:10.908135 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:30:10.908280 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:10.908282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:10.908330 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:10.908406 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:10.908638 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.909156 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.909977 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:10.910188 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:10.910284 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:10.910529 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:10.910909 (+ 380us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:10.910999 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:10.911069 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 08:30:10.911113 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:30:10.916913 30869 raft_consensus.cc:1261] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc [term 1 FOLLOWER]: Refusing update from remote peer 39a9b0cea43c42138125c231bd3c061b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:10.916939 31004 raft_consensus.cc:1261] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d [term 1 FOLLOWER]: Refusing update from remote peer 39a9b0cea43c42138125c231bd3c061b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:10.917570 31076 consensus_queue.cc:1035] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eab94af158440d1b8e40b06ba6b6abc" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:10.917812 31081 consensus_queue.cc:1035] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e668266b3dce40799c14e073c154e64d" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 36761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:10.934381 30578 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:10.934520 30578 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:10.936792 30578 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf781bb3aa8e4bac9f6a31273099713e: Sending DeleteTablet for 3 replicas of tablet 85b8a5c8c8b047ceb10c5748280321a9
I20260808 08:30:10.937507 30847 tablet_service.cc:1514] Processing DeleteTablet for tablet 85b8a5c8c8b047ceb10c5748280321a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:10 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:55968
I20260808 08:30:10.937523 30984 tablet_service.cc:1514] Processing DeleteTablet for tablet 85b8a5c8c8b047ceb10c5748280321a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:10 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:32952
I20260808 08:30:10.937700 30709 tablet_service.cc:1514] Processing DeleteTablet for tablet 85b8a5c8c8b047ceb10c5748280321a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:10 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:47134
I20260808 08:30:10.938092 31096 tablet_replica.cc:330] T 85b8a5c8c8b047ceb10c5748280321a9 P 39a9b0cea43c42138125c231bd3c061b: stopping tablet replica
I20260808 08:30:10.938247 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 30645
I20260808 08:30:10.940887 31095 tablet_replica.cc:330] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: stopping tablet replica
I20260808 08:30:10.941165 31095 raft_consensus.cc:2229] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:10.941440 31095 raft_consensus.cc:2258] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:10.941727 31094 tablet_replica.cc:330] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: stopping tablet replica
I20260808 08:30:10.941995 31094 raft_consensus.cc:2229] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:10.942313 31094 raft_consensus.cc:2258] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:10.943022 31095 ts_tablet_manager.cc:1905] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:10.943763 31094 ts_tablet_manager.cc:1905] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:10.945926 31095 ts_tablet_manager.cc:1918] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:10.946024 31095 log.cc:1196] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/85b8a5c8c8b047ceb10c5748280321a9
I20260808 08:30:10.946382 31095 ts_tablet_manager.cc:1939] T 85b8a5c8c8b047ceb10c5748280321a9 P 7eab94af158440d1b8e40b06ba6b6abc: Deleting consensus metadata
I20260808 08:30:10.946616 31094 ts_tablet_manager.cc:1918] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:10.946722 31094 log.cc:1196] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/85b8a5c8c8b047ceb10c5748280321a9
I20260808 08:30:10.947048 31094 ts_tablet_manager.cc:1939] T 85b8a5c8c8b047ceb10c5748280321a9 P e668266b3dce40799c14e073c154e64d: Deleting consensus metadata
W20260808 08:30:10.947486 30563 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:46373 (error 108)
I20260808 08:30:10.947641 30564 catalog_manager.cc:4841] TS 7eab94af158440d1b8e40b06ba6b6abc (127.25.170.2:40039): tablet 85b8a5c8c8b047ceb10c5748280321a9 (table test-table [id=a0c4ecb4b52d451987d9aaf903d18f95]) successfully deleted
I20260808 08:30:10.948367 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 30785
I20260808 08:30:10.948406 30566 catalog_manager.cc:4841] TS e668266b3dce40799c14e073c154e64d (127.25.170.3:36761): tablet 85b8a5c8c8b047ceb10c5748280321a9 (table test-table [id=a0c4ecb4b52d451987d9aaf903d18f95]) successfully deleted
I20260808 08:30:10.948556 31067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:10.948274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:46373 (local address 127.0.0.1:47150)
0808 08:30:10.948391 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:10.948462 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:46373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 08:30:10.952641 30563 catalog_manager.cc:4584] TS 39a9b0cea43c42138125c231bd3c061b (127.25.170.1:46373): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 85b8a5c8c8b047ceb10c5748280321a9: Network error: Client connection negotiation failed: client connection to 127.25.170.1:46373: connect: Connection refused (error 111)
I20260808 08:30:10.957894 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 30921
I20260808 08:30:10.965677 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 30546
2026-08-08T08:30:10Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2290 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T08:30:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:10Z Disabled control of system clock
I20260808 08:30:10.998872 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:41527
--webserver_interface=127.25.170.62
--webserver_port=0
--builtin_ntp_servers=127.25.170.20:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:41527
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 08:30:11.108939 31101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:11.109176 31101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:11.109211 31101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:11.112998 31101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:11.113041 31101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:11.113056 31101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:11.113073 31101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:11.113088 31101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:11.118031 31101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:41527
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:41527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:11.119032 31101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:11.120344 31101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:11.128790 31109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:11.128756 31106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:11.128751 31107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:11.128813 31101 server_base.cc:1034] running on GCE node
I20260808 08:30:11.129649 31101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:11.130863 31101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:11.132058 31101 hybrid_clock.cc:648] HybridClock initialized: now 1786177811132045 us; error 30 us; skew 500 ppm
I20260808 08:30:11.134212 31101 webserver.cc:460] Webserver started at http://127.25.170.62:41859/ using document root <none> and password file <none>
I20260808 08:30:11.134830 31101 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:11.134929 31101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:11.135157 31101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:11.137840 31101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "3c46ae6bf45546279b1d720fe39d55d5"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "9d4e1e21b8b33edea6ef93227024fabe"
server_key_iv: "2cff9c191da6eb04cc5c2d0a44fe0c75"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.138468 31101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "3c46ae6bf45546279b1d720fe39d55d5"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "9d4e1e21b8b33edea6ef93227024fabe"
server_key_iv: "2cff9c191da6eb04cc5c2d0a44fe0c75"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.142485 31101 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 08:30:11.145147 31115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:11.146458 31101 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:11.146617 31101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "3c46ae6bf45546279b1d720fe39d55d5"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "9d4e1e21b8b33edea6ef93227024fabe"
server_key_iv: "2cff9c191da6eb04cc5c2d0a44fe0c75"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.146744 31101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:11.151719 31101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:11.152397 31101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:11.152590 31101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:11.159775 31101 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:41527
I20260808 08:30:11.159781 31170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:41527 every 8 connection(s)
I20260808 08:30:11.160774 31101 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:11.164007 31171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:11.164418 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 31101
I20260808 08:30:11.164547 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:11.164860 26280 external_mini_cluster.cc:1428] Setting key b764340b929914f48cc5b9085a0ed094
I20260808 08:30:11.170459 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.166270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34104 (local address 127.25.170.62:41527)
0808 08:30:11.166922 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.166937 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.166972 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:30:11.167676 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.167694 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.168101 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.168448 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.169232 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.169237 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.169248 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.169260 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.169320 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.169335 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.169488 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.169561 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.169799 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":154,"threads_started":1}
I20260808 08:30:11.170989 31171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5: Bootstrap starting.
I20260808 08:30:11.173514 31171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:11.174296 31171 log.cc:824] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:11.176385 31171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5: No bootstrap required, opened a new log
I20260808 08:30:11.180157 31171 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c46ae6bf45546279b1d720fe39d55d5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41527 } }
I20260808 08:30:11.180389 31171 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:11.180461 31171 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c46ae6bf45546279b1d720fe39d55d5, State: Initialized, Role: FOLLOWER
I20260808 08:30:11.180908 31171 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c46ae6bf45546279b1d720fe39d55d5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41527 } }
I20260808 08:30:11.181057 31171 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:11.181124 31171 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:11.181222 31171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:11.182152 31171 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c46ae6bf45546279b1d720fe39d55d5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41527 } }
I20260808 08:30:11.182480 31171 leader_election.cc:302] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c46ae6bf45546279b1d720fe39d55d5; no voters:
I20260808 08:30:11.182837 31171 leader_election.cc:288] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:11.182928 31177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:11.183156 31177 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [term 1 LEADER]: Becoming Leader. State: Replica: 3c46ae6bf45546279b1d720fe39d55d5, State: Running, Role: LEADER
I20260808 08:30:11.183472 31177 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c46ae6bf45546279b1d720fe39d55d5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41527 } }
I20260808 08:30:11.184098 31171 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:11.185159 31179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c46ae6bf45546279b1d720fe39d55d5. Latest consensus state: current_term: 1 leader_uuid: "3c46ae6bf45546279b1d720fe39d55d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c46ae6bf45546279b1d720fe39d55d5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41527 } } }
I20260808 08:30:11.185156 31178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c46ae6bf45546279b1d720fe39d55d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c46ae6bf45546279b1d720fe39d55d5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41527 } } }
I20260808 08:30:11.185300 31179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:11.185312 31178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:11.186439 31186 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:11.189050 31186 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:11.194316 31186 catalog_manager.cc:1347] Generated new cluster ID: b6027f91bec04b5096aa4dd7b37f3d5f
I20260808 08:30:11.194382 31186 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:11.221333 31186 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:11.221671 31186 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:11.228641 31186 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5: Generated new TSK 0
I20260808 08:30:11.229378 31186 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:30:11.233027 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41527
--builtin_ntp_servers=127.25.170.20:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 08:30:11.347841 31197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:11.348133 31197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:11.348172 31197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:11.352337 31197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:11.352389 31197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:11.352442 31197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:11.357093 31197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:11.358090 31197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:11.359477 31197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:11.368858 31202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:11.368902 31203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:11.369109 31205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:11.369235 31197 server_base.cc:1034] running on GCE node
I20260808 08:30:11.369658 31197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:11.370278 31197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:11.371460 31197 hybrid_clock.cc:648] HybridClock initialized: now 1786177811371434 us; error 50 us; skew 500 ppm
I20260808 08:30:11.373447 31197 webserver.cc:460] Webserver started at http://127.25.170.1:46673/ using document root <none> and password file <none>
I20260808 08:30:11.374033 31197 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:11.374121 31197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:11.374348 31197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:11.376569 31197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "f159861599c0428da4d0689360d9e939"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "be98ebc27826ac0541580b54477ede89"
server_key_iv: "3251d4be003005612efcc1353393c79a"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.377158 31197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "f159861599c0428da4d0689360d9e939"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "be98ebc27826ac0541580b54477ede89"
server_key_iv: "3251d4be003005612efcc1353393c79a"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.380863 31197 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:30:11.383317 31211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:11.384575 31197 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:11.384701 31197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "f159861599c0428da4d0689360d9e939"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "be98ebc27826ac0541580b54477ede89"
server_key_iv: "3251d4be003005612efcc1353393c79a"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.384828 31197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:11.389671 31197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:11.390311 31197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:11.390491 31197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:11.391036 31197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:11.391950 31197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:11.392017 31197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:11.392083 31197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:11.392128 31197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:11.400954 31197 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:35061
I20260808 08:30:11.401010 31328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:35061 every 8 connection(s)
I20260808 08:30:11.401834 31197 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:11.407956 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.403565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:36927 (local address 127.25.170.62:41527)
0808 08:30:11.403703 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.403707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.404882 (+ 1175us) server_negotiation.cc:407] Connection header received
0808 08:30:11.406225 (+ 1343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.406229 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.406274 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.406387 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.407451 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.407455 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.407458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.407471 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.407497 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.407505 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.407599 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.407748 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.407803 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:30:11.408809 31331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.404053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41527 (local address 127.25.170.1:36927)
0808 08:30:11.404724 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:11.404763 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:11.406009 (+ 1246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:11.406553 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:11.406559 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:11.406644 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:11.407174 (+ 530us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:11.407175 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:11.407215 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:11.407298 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:11.407593 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:11.407603 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:11.407611 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 08:30:11.407789 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 08:30:11.408054 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":141,"threads_started":1}
I20260808 08:30:11.409866 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 31197
I20260808 08:30:11.409998 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:11.409988 31329 heartbeater.cc:347] Connected to a master server at 127.25.170.62:41527
I20260808 08:30:11.410212 31329 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:11.410329 26280 external_mini_cluster.cc:1428] Setting key 94b2c1e8520c862f6b72217e6d54f4a3
I20260808 08:30:11.410640 31329 heartbeater.cc:511] Master 127.25.170.62:41527 requested a full tablet report, sending...
I20260808 08:30:11.412211 31132 ts_manager.cc:194] Registered new tserver with Master: f159861599c0428da4d0689360d9e939 (127.25.170.1:35061)
I20260808 08:30:11.412256 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41527
--builtin_ntp_servers=127.25.170.20:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 08:30:11.527444 31332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:11.527683 31332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:11.527750 31332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:11.531735 31332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:11.531788 31332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:11.531896 31332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:11.536573 31332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:11.537582 31332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:11.538980 31332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:11.548174 31337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:11.548442 31338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:11.548413 31332 server_base.cc:1034] running on GCE node
W20260808 08:30:11.548430 31340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:11.548959 31332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:11.549561 31332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:11.550714 31332 hybrid_clock.cc:648] HybridClock initialized: now 1786177811550698 us; error 27 us; skew 500 ppm
I20260808 08:30:11.552574 31332 webserver.cc:460] Webserver started at http://127.25.170.2:40655/ using document root <none> and password file <none>
I20260808 08:30:11.553157 31332 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:11.553222 31332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:11.553449 31332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:11.555476 31332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "95b67b7fe81f4498bdf2565ec602495c"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "7658798f77a39e7e2e83040adc9b72f7"
server_key_iv: "63978b0c7d717aba7fc97353cee70478"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.556094 31332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "95b67b7fe81f4498bdf2565ec602495c"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "7658798f77a39e7e2e83040adc9b72f7"
server_key_iv: "63978b0c7d717aba7fc97353cee70478"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.559680 31332 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:30:11.562110 31346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:11.563284 31332 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:11.563398 31332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "95b67b7fe81f4498bdf2565ec602495c"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "7658798f77a39e7e2e83040adc9b72f7"
server_key_iv: "63978b0c7d717aba7fc97353cee70478"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.563496 31332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:11.567935 31332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:11.568584 31332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:11.568759 31332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:11.569293 31332 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:11.570169 31332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:11.570220 31332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:11.570297 31332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:11.570330 31332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:11.579147 31332 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:40229
I20260808 08:30:11.579169 31465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:40229 every 8 connection(s)
I20260808 08:30:11.580063 31332 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:11.586012 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.581809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:51837 (local address 127.25.170.62:41527)
0808 08:30:11.581940 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.581944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.582904 (+ 960us) server_negotiation.cc:407] Connection header received
0808 08:30:11.584293 (+ 1389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.584297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.584339 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.584415 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.585565 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.585568 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.585570 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.585583 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.585604 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.585612 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.585752 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.585860 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.585905 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 08:30:11.586809 31468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.582148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41527 (local address 127.25.170.2:51837)
0808 08:30:11.582780 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:11.582818 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:11.584099 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:11.584641 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:11.584648 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:11.584734 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:11.585319 (+ 585us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:11.585320 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:11.585359 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:11.585424 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:11.585729 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:11.585741 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:11.585746 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:30:11.585882 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 08:30:11.586069 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":124,"threads_started":1}
I20260808 08:30:11.587926 31466 heartbeater.cc:347] Connected to a master server at 127.25.170.62:41527
I20260808 08:30:11.588129 31466 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:11.588475 31466 heartbeater.cc:511] Master 127.25.170.62:41527 requested a full tablet report, sending...
I20260808 08:30:11.589025 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 31332
I20260808 08:30:11.589154 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:11.589452 26280 external_mini_cluster.cc:1428] Setting key 5c7253a55d89b45404a92e20f6b158dd
I20260808 08:30:11.589545 31132 ts_manager.cc:194] Registered new tserver with Master: 95b67b7fe81f4498bdf2565ec602495c (127.25.170.2:40229)
I20260808 08:30:11.591301 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41527
--builtin_ntp_servers=127.25.170.20:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 08:30:11.703763 31469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:11.704056 31469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:11.704098 31469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:11.708101 31469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:11.708146 31469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:11.708197 31469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:11.712687 31469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:11.713649 31469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:11.714956 31469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:11.724246 31479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:11.724239 31477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:11.724411 31469 server_base.cc:1034] running on GCE node
W20260808 08:30:11.724238 31476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:11.724910 31469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:11.725610 31469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:11.726792 31469 hybrid_clock.cc:648] HybridClock initialized: now 1786177811726775 us; error 29 us; skew 500 ppm
I20260808 08:30:11.728732 31469 webserver.cc:460] Webserver started at http://127.25.170.3:45939/ using document root <none> and password file <none>
I20260808 08:30:11.729295 31469 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:11.729357 31469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:11.729590 31469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:11.731694 31469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "fb8766f753aa45dfbe4232ea78ea12e6"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "dac895553fafd1f233dc026de080aa4f"
server_key_iv: "b3d31f50c674ec547672f6f16ce48019"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.732312 31469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "fb8766f753aa45dfbe4232ea78ea12e6"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "dac895553fafd1f233dc026de080aa4f"
server_key_iv: "b3d31f50c674ec547672f6f16ce48019"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.735842 31469 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:30:11.738260 31485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:11.739423 31469 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:11.739538 31469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "fb8766f753aa45dfbe4232ea78ea12e6"
format_stamp: "Formatted at 2026-08-08 08:30:11 on dist-test-slave-zkpd"
server_key: "dac895553fafd1f233dc026de080aa4f"
server_key_iv: "b3d31f50c674ec547672f6f16ce48019"
server_key_version: "encryptionkey@0"
I20260808 08:30:11.739639 31469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:11.744155 31469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:11.744761 31469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:11.744931 31469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:11.745478 31469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:11.746363 31469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:11.746429 31469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:11.746496 31469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:11.746542 31469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:11.756070 31469 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:45617
I20260808 08:30:11.756096 31602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:45617 every 8 connection(s)
I20260808 08:30:11.756914 31469 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:11.757814 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 31469
I20260808 08:30:11.757952 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:11.758221 26280 external_mini_cluster.cc:1428] Setting key f0e2bf7f1585fbd819f62847caaa8065
I20260808 08:30:11.764087 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.759760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:34417 (local address 127.25.170.62:41527)
0808 08:30:11.759918 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.759923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.761113 (+ 1190us) server_negotiation.cc:407] Connection header received
0808 08:30:11.762369 (+ 1256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.762372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.762406 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.762471 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.763509 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.763512 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.763514 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.763527 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.763548 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.763557 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.763635 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.763869 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.763973 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:30:11.764817 31605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.760257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41527 (local address 127.25.170.3:34417)
0808 08:30:11.760967 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:11.761019 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:11.762200 (+ 1181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:11.762595 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:11.762601 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:11.762682 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:11.763263 (+ 581us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:11.763265 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:11.763304 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:11.763369 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:11.763641 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:11.763648 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:11.763652 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:30:11.763805 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 08:30:11.764056 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":137,"threads_started":1}
I20260808 08:30:11.765955 31603 heartbeater.cc:347] Connected to a master server at 127.25.170.62:41527
I20260808 08:30:11.766146 31603 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:11.766490 31603 heartbeater.cc:511] Master 127.25.170.62:41527 requested a full tablet report, sending...
I20260808 08:30:11.767483 31132 ts_manager.cc:194] Registered new tserver with Master: fb8766f753aa45dfbe4232ea78ea12e6 (127.25.170.3:45617)
I20260808 08:30:11.772013 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:30:11.775686 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.773893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34110 (local address 127.25.170.62:41527)
0808 08:30:11.774000 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.774003 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.774306 (+ 303us) server_negotiation.cc:407] Connection header received
0808 08:30:11.774449 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.774455 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.774495 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.774575 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.775309 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.775312 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.775315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.775327 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.775347 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.775356 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.775447 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.775520 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.775562 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 08:30:11.778456 31132 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34110:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:30:11.781396 31132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:30:11.793095 31615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.789643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:40229 (local address 127.0.0.1:53128)
0808 08:30:11.789994 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:11.790050 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:11.790150 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:11.791695 (+ 1545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:11.791697 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:11.791710 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:11.792274 (+ 564us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:11.792275 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:11.792291 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:11.792376 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:11.792751 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:11.792761 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:11.792766 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:30:11.792871 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 08:30:11.792936 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":89,"threads_started":1}
I20260808 08:30:11.793111 31617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.789748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53128 (local address 127.25.170.2:40229)
0808 08:30:11.790553 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.790567 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.790596 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:30:11.790654 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.790662 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.790878 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.791033 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.792550 (+ 1517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.792559 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.792573 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.792585 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.792634 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.792659 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.792766 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.792884 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.792954 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":139,"threads_started":1}
I20260808 08:30:11.793125 31618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.790466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:45617 (local address 127.0.0.1:50868)
0808 08:30:11.790698 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:11.790713 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:11.790788 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:11.791865 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:11.791871 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:11.791909 (+ 38us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:11.792441 (+ 532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:11.792445 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:11.792458 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:11.792484 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:11.792803 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:11.792806 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:11.792809 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 08:30:11.792865 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 08:30:11.792938 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":99,"threads_started":1}
I20260808 08:30:11.793932 31621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.790871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50868 (local address 127.25.170.3:45617)
0808 08:30:11.791466 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.791479 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.791503 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:30:11.791554 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.791559 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.791713 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.791865 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.792589 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.792596 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.792607 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.792620 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.792661 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.792696 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.793612 (+ 916us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.793659 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.793749 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":170,"threads_started":1}
I20260808 08:30:11.794090 31616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.789739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:35061 (local address 127.0.0.1:44982)
0808 08:30:11.790339 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:11.790353 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:11.790434 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:11.791578 (+ 1144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:11.791584 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:11.791658 (+ 74us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:11.792589 (+ 931us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:11.792591 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:11.792602 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:11.792628 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:11.793855 (+ 1227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:11.793858 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:11.793862 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:30:11.793921 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 08:30:11.793958 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":104,"threads_started":1}
I20260808 08:30:11.794744 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.790433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44982 (local address 127.25.170.1:35061)
0808 08:30:11.791062 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.791074 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.791099 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:30:11.791155 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.791161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.791344 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.792783 (+ 1439us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.793378 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.793384 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.793393 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.793405 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.793443 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.793470 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.794491 (+ 1021us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.794538 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.794600 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":149,"threads_started":1}
I20260808 08:30:11.796376 31397 tablet_service.cc:1467] Processing CreateTablet for tablet d339eab0381344ef996ec4165faeafc2 (DEFAULT_TABLE table=test-table [id=82159f5fcec94e5b8473ae844685807e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:11.796747 31536 tablet_service.cc:1467] Processing CreateTablet for tablet d339eab0381344ef996ec4165faeafc2 (DEFAULT_TABLE table=test-table [id=82159f5fcec94e5b8473ae844685807e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:11.797076 31260 tablet_service.cc:1467] Processing CreateTablet for tablet d339eab0381344ef996ec4165faeafc2 (DEFAULT_TABLE table=test-table [id=82159f5fcec94e5b8473ae844685807e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:11.797528 31397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d339eab0381344ef996ec4165faeafc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:11.797659 31536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d339eab0381344ef996ec4165faeafc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:11.797806 31260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d339eab0381344ef996ec4165faeafc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:11.803591 31622 tablet_bootstrap.cc:492] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939: Bootstrap starting.
I20260808 08:30:11.805104 31623 tablet_bootstrap.cc:492] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: Bootstrap starting.
I20260808 08:30:11.805478 31624 tablet_bootstrap.cc:492] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: Bootstrap starting.
I20260808 08:30:11.806398 31622 tablet_bootstrap.cc:654] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:11.807101 31622 log.cc:824] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:11.807178 31624 tablet_bootstrap.cc:654] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:11.808066 31624 log.cc:824] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:11.809211 31622 tablet_bootstrap.cc:492] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939: No bootstrap required, opened a new log
I20260808 08:30:11.809403 31622 ts_tablet_manager.cc:1397] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260808 08:30:11.809433 31623 tablet_bootstrap.cc:654] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:11.809896 31624 tablet_bootstrap.cc:492] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: No bootstrap required, opened a new log
I20260808 08:30:11.810088 31624 ts_tablet_manager.cc:1397] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 08:30:11.810204 31623 log.cc:824] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:11.812160 31623 tablet_bootstrap.cc:492] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: No bootstrap required, opened a new log
I20260808 08:30:11.812376 31623 ts_tablet_manager.cc:1397] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 08:30:11.813638 31624 raft_consensus.cc:348] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 } } peers { permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 } } peers { permanent_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45617 } }
I20260808 08:30:11.813884 31624 raft_consensus.cc:374] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:11.813961 31624 raft_consensus.cc:729] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b67b7fe81f4498bdf2565ec602495c, State: Initialized, Role: FOLLOWER
I20260808 08:30:11.813807 31622 raft_consensus.cc:348] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 } } peers { permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 } } peers { permanent_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45617 } }
I20260808 08:30:11.814096 31622 raft_consensus.cc:374] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:11.814184 31622 raft_consensus.cc:729] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f159861599c0428da4d0689360d9e939, State: Initialized, Role: FOLLOWER
I20260808 08:30:11.814554 31624 consensus_queue.cc:260] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 } } peers { permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 } } peers { permanent_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45617 } }
I20260808 08:30:11.814657 31622 consensus_queue.cc:260] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 } } peers { permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 } } peers { permanent_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45617 } }
I20260808 08:30:11.815213 31466 heartbeater.cc:503] Master 127.25.170.62:41527 was elected leader, sending a full tablet report...
I20260808 08:30:11.815505 31624 ts_tablet_manager.cc:1428] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 08:30:11.815572 31622 ts_tablet_manager.cc:1428] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 08:30:11.815927 31329 heartbeater.cc:503] Master 127.25.170.62:41527 was elected leader, sending a full tablet report...
I20260808 08:30:11.817520 31623 raft_consensus.cc:348] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 } } peers { permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 } } peers { permanent_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45617 } }
I20260808 08:30:11.817705 31623 raft_consensus.cc:374] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:11.817759 31623 raft_consensus.cc:729] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb8766f753aa45dfbe4232ea78ea12e6, State: Initialized, Role: FOLLOWER
I20260808 08:30:11.818174 31623 consensus_queue.cc:260] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 } } peers { permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 } } peers { permanent_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45617 } }
I20260808 08:30:11.818835 31603 heartbeater.cc:503] Master 127.25.170.62:41527 was elected leader, sending a full tablet report...
I20260808 08:30:11.819140 31623 ts_tablet_manager.cc:1428] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260808 08:30:11.830961 31467 tablet.cc:2369] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:30:11.899658 31630 raft_consensus.cc:482] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:11.899940 31630 raft_consensus.cc:504] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 } } peers { permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 } } peers { permanent_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45617 } }
I20260808 08:30:11.901151 31630 leader_election.cc:288] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b67b7fe81f4498bdf2565ec602495c (127.25.170.2:40229), f159861599c0428da4d0689360d9e939 (127.25.170.1:35061)
W20260808 08:30:11.902990 31330 tablet.cc:2369] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:30:11.903076 31605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.901398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:40229 (local address 127.25.170.3:53933)
0808 08:30:11.901517 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:11.901535 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:11.901616 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:11.901919 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:11.901922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:11.901939 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:11.902479 (+ 540us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:11.902480 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:11.902490 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:11.902514 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:11.902796 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:11.902800 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:11.902805 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:30:11.902900 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 08:30:11.902937 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 08:30:11.903126 31617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.901499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:53933 (local address 127.25.170.2:40229)
0808 08:30:11.901616 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.901622 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.901636 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:11.901751 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.901754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.901795 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.901890 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.902639 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.902643 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.902645 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.902663 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.902680 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.902688 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.902773 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.902931 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.902978 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:30:11.903358 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.901523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:47307 (local address 127.25.170.1:35061)
0808 08:30:11.901671 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.901677 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.902069 (+ 392us) server_negotiation.cc:407] Connection header received
0808 08:30:11.902124 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.902127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.902169 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.902231 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.902898 (+ 667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.902902 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.902905 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.902919 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.902941 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.902950 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.903028 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.903194 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.903236 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:30:11.903669 31631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.901407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:35061 (local address 127.25.170.3:47307)
0808 08:30:11.901967 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:11.901978 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:11.902060 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:11.902275 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:11.902278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:11.902295 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:11.902723 (+ 428us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:11.902725 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:11.902735 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:11.902759 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:11.903067 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:11.903069 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:11.903073 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:30:11.903492 (+ 419us) client_negotiation.cc:240] Negotiation successful
0808 08:30:11.903531 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":128,"thread_start_us":203,"threads_started":1}
I20260808 08:30:11.904141 31417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d339eab0381344ef996ec4165faeafc2" candidate_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b67b7fe81f4498bdf2565ec602495c" is_pre_election: true
I20260808 08:30:11.904276 31280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d339eab0381344ef996ec4165faeafc2" candidate_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f159861599c0428da4d0689360d9e939" is_pre_election: true
I20260808 08:30:11.904462 31417 raft_consensus.cc:2454] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb8766f753aa45dfbe4232ea78ea12e6 in term 0.
I20260808 08:30:11.904614 31280 raft_consensus.cc:2454] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb8766f753aa45dfbe4232ea78ea12e6 in term 0.
I20260808 08:30:11.904939 31486 leader_election.cc:302] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b67b7fe81f4498bdf2565ec602495c, fb8766f753aa45dfbe4232ea78ea12e6; no voters:
I20260808 08:30:11.905206 31630 raft_consensus.cc:2781] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:30:11.905318 31630 raft_consensus.cc:482] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:30:11.905364 31630 raft_consensus.cc:3037] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:11.906430 31630 raft_consensus.cc:504] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 } } peers { permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 } } peers { permanent_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45617 } }
I20260808 08:30:11.906751 31630 leader_election.cc:288] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b67b7fe81f4498bdf2565ec602495c (127.25.170.2:40229), f159861599c0428da4d0689360d9e939 (127.25.170.1:35061)
I20260808 08:30:11.907038 31417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d339eab0381344ef996ec4165faeafc2" candidate_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b67b7fe81f4498bdf2565ec602495c"
I20260808 08:30:11.907123 31280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d339eab0381344ef996ec4165faeafc2" candidate_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f159861599c0428da4d0689360d9e939"
I20260808 08:30:11.907176 31417 raft_consensus.cc:3037] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:11.907287 31280 raft_consensus.cc:3037] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:11.908306 31417 raft_consensus.cc:2454] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb8766f753aa45dfbe4232ea78ea12e6 in term 1.
I20260808 08:30:11.908437 31280 raft_consensus.cc:2454] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb8766f753aa45dfbe4232ea78ea12e6 in term 1.
I20260808 08:30:11.908587 31486 leader_election.cc:302] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b67b7fe81f4498bdf2565ec602495c, fb8766f753aa45dfbe4232ea78ea12e6; no voters:
I20260808 08:30:11.908752 31630 raft_consensus.cc:2781] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:11.908988 31630 raft_consensus.cc:686] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 1 LEADER]: Becoming Leader. State: Replica: fb8766f753aa45dfbe4232ea78ea12e6, State: Running, Role: LEADER
I20260808 08:30:11.909322 31630 consensus_queue.cc:237] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 } } peers { permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 } } peers { permanent_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45617 } }
I20260808 08:30:11.912536 31132 catalog_manager.cc:5495] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb8766f753aa45dfbe4232ea78ea12e6 (127.25.170.3). New cstate: current_term: 1 leader_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb8766f753aa45dfbe4232ea78ea12e6" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45617 } health_report { overall_health: HEALTHY } } }
I20260808 08:30:11.945909 31621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.944540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50870 (local address 127.25.170.3:45617)
0808 08:30:11.944659 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:11.944662 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:11.944675 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:11.944836 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:11.944838 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:11.944900 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:11.944970 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:11.945603 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:11.945606 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:11.945608 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:11.945618 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:11.945638 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:11.945646 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:11.945721 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:11.945761 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 08:30:11.945807 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 08:30:11.951660 31417 raft_consensus.cc:1261] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c [term 1 FOLLOWER]: Refusing update from remote peer fb8766f753aa45dfbe4232ea78ea12e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:11.951735 31280 raft_consensus.cc:1261] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939 [term 1 FOLLOWER]: Refusing update from remote peer fb8766f753aa45dfbe4232ea78ea12e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:11.952451 31632 consensus_queue.cc:1035] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f159861599c0428da4d0689360d9e939" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:11.952641 31630 consensus_queue.cc:1035] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b67b7fe81f4498bdf2565ec602495c" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 40229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:11.960050 31637 mvcc.cc:205] Tried to move back new op lower bound from 7316184317747105792 to 7316184317583405056. Current Snapshot: MvccSnapshot[applied={T|T < 7316184317747105792}]
I20260808 08:30:11.960585 31636 mvcc.cc:205] Tried to move back new op lower bound from 7316184317747105792 to 7316184317583405056. Current Snapshot: MvccSnapshot[applied={T|T < 7316184317747105792}]
I20260808 08:30:11.969483 31132 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:11.969614 31132 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:11.971735 31132 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c46ae6bf45546279b1d720fe39d55d5: Sending DeleteTablet for 3 replicas of tablet d339eab0381344ef996ec4165faeafc2
I20260808 08:30:11.972503 31397 tablet_service.cc:1514] Processing DeleteTablet for tablet d339eab0381344ef996ec4165faeafc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:11 UTC) from {username='slave'} at 127.0.0.1:53128
I20260808 08:30:11.972513 31260 tablet_service.cc:1514] Processing DeleteTablet for tablet d339eab0381344ef996ec4165faeafc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:11 UTC) from {username='slave'} at 127.0.0.1:44982
I20260808 08:30:11.972661 31536 tablet_service.cc:1514] Processing DeleteTablet for tablet d339eab0381344ef996ec4165faeafc2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:11 UTC) from {username='slave'} at 127.0.0.1:50868
I20260808 08:30:11.973170 31646 tablet_replica.cc:330] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: stopping tablet replica
I20260808 08:30:11.973353 31648 tablet_replica.cc:330] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: stopping tablet replica
I20260808 08:30:11.973372 31647 tablet_replica.cc:330] T d339eab0381344ef996ec4165faeafc2 P f159861599c0428da4d0689360d9e939: stopping tablet replica
I20260808 08:30:11.973574 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 31197
I20260808 08:30:11.973660 31648 raft_consensus.cc:2229] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:30:11.974035 31648 raft_consensus.cc:2258] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:11.978093 31646 raft_consensus.cc:2229] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:11.978490 31646 raft_consensus.cc:2258] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:11.979890 31646 ts_tablet_manager.cc:1905] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:11.983305 31646 ts_tablet_manager.cc:1918] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:11.983419 31646 log.cc:1196] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/d339eab0381344ef996ec4165faeafc2
I20260808 08:30:11.983754 31646 ts_tablet_manager.cc:1939] T d339eab0381344ef996ec4165faeafc2 P 95b67b7fe81f4498bdf2565ec602495c: Deleting consensus metadata
I20260808 08:30:11.984967 31648 ts_tablet_manager.cc:1905] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:11.985213 31116 catalog_manager.cc:4841] TS 95b67b7fe81f4498bdf2565ec602495c (127.25.170.2:40229): tablet d339eab0381344ef996ec4165faeafc2 (table test-table [id=82159f5fcec94e5b8473ae844685807e]) successfully deleted
I20260808 08:30:11.987793 31648 ts_tablet_manager.cc:1918] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:11.987941 31648 log.cc:1196] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/d339eab0381344ef996ec4165faeafc2
I20260808 08:30:11.988276 31648 ts_tablet_manager.cc:1939] T d339eab0381344ef996ec4165faeafc2 P fb8766f753aa45dfbe4232ea78ea12e6: Deleting consensus metadata
W20260808 08:30:11.988494 31119 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:35061 (error 108)
I20260808 08:30:11.989408 31118 catalog_manager.cc:4841] TS fb8766f753aa45dfbe4232ea78ea12e6 (127.25.170.3:45617): tablet d339eab0381344ef996ec4165faeafc2 (table test-table [id=82159f5fcec94e5b8473ae844685807e]) successfully deleted
I20260808 08:30:11.989483 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 31332
I20260808 08:30:11.989665 31616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:11.989231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:35061 (local address 127.0.0.1:44992)
0808 08:30:11.989491 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:11.989570 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:35061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167}
W20260808 08:30:11.989930 31119 catalog_manager.cc:4584] TS f159861599c0428da4d0689360d9e939 (127.25.170.1:35061): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d339eab0381344ef996ec4165faeafc2: Network error: Client connection negotiation failed: client connection to 127.25.170.1:35061: connect: Connection refused (error 111)
I20260808 08:30:11.997339 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 31469
I20260808 08:30:12.004277 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 31101
2026-08-08T08:30:12Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1036 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 08:30:12.026779 26280 mini_oidc.cc:152] Starting JWKS server
I20260808 08:30:12.028414 26280 webserver.cc:460] Webserver started at https://127.0.0.1:37943/ using document root <none> and password file <none>
I20260808 08:30:12.028549 26280 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:30:12.028766 26280 webserver.cc:460] Webserver started at http://127.0.0.1:40755/ using document root <none> and password file <none>
2026-08-08T08:30:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:12Z Disabled control of system clock
I20260808 08:30:12.038942 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:43101
--webserver_interface=127.25.170.62
--webserver_port=0
--builtin_ntp_servers=127.25.170.20:40875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:43101
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37943/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/testchainca.cert with env {}
W20260808 08:30:12.151014 31655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:12.151278 31655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:12.151317 31655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:12.155470 31655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:12.155522 31655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:12.155539 31655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:12.155555 31655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:12.155570 31655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:30:12.155586 31655 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:30:12.155608 31655 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37943/jwks.json
I20260808 08:30:12.161183 31655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:40875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:43101
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:43101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37943/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:12.162300 31655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:12.163313 31655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:12.171667 31660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:12.171787 31663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:12.171968 31655 server_base.cc:1034] running on GCE node
W20260808 08:30:12.171675 31661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:12.172668 31655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:12.173678 31655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:12.174860 31655 hybrid_clock.cc:648] HybridClock initialized: now 1786177812174844 us; error 29 us; skew 500 ppm
I20260808 08:30:12.176573 31655 webserver.cc:460] Webserver started at http://127.25.170.62:32811/ using document root <none> and password file <none>
I20260808 08:30:12.177147 31655 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:12.177208 31655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:12.177469 31655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:12.179441 31655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a"
format_stamp: "Formatted at 2026-08-08 08:30:12 on dist-test-slave-zkpd"
server_key: "68409498a1c1532fe355521eb7519279"
server_key_iv: "275e462ef741a413a3b930b71c45c69f"
server_key_version: "encryptionkey@0"
I20260808 08:30:12.180063 31655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a"
format_stamp: "Formatted at 2026-08-08 08:30:12 on dist-test-slave-zkpd"
server_key: "68409498a1c1532fe355521eb7519279"
server_key_iv: "275e462ef741a413a3b930b71c45c69f"
server_key_version: "encryptionkey@0"
I20260808 08:30:12.183457 31655 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:30:12.185794 31670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:12.186939 31655 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:12.187062 31655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a"
format_stamp: "Formatted at 2026-08-08 08:30:12 on dist-test-slave-zkpd"
server_key: "68409498a1c1532fe355521eb7519279"
server_key_iv: "275e462ef741a413a3b930b71c45c69f"
server_key_version: "encryptionkey@0"
I20260808 08:30:12.187160 31655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:12.210832 31655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:12.211506 31655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:12.211690 31655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:12.218604 31655 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:43101
I20260808 08:30:12.218616 31722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:43101 every 8 connection(s)
I20260808 08:30:12.219528 31655 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:12.222652 31723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:12.224831 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 31655
I20260808 08:30:12.224960 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:12.225229 26280 external_mini_cluster.cc:1428] Setting key 426abeb28beb7905c97f78349d7bb853
I20260808 08:30:12.228567 31723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a: Bootstrap starting.
I20260808 08:30:12.230741 31723 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:12.231473 31723 log.cc:824] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:12.233585 31723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a: No bootstrap required, opened a new log
I20260808 08:30:12.234689 31726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:12.226591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32774 (local address 127.25.170.62:43101)
0808 08:30:12.227218 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:12.227233 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:12.227280 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:30:12.227971 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:12.227990 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:12.228427 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:12.228790 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:12.229292 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.230215 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.231165 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.231662 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.231840 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:12.232716 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:12.232722 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:12.232738 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:12.233213 (+ 475us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:12.233296 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:12.233324 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:12.233426 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:12.233536 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 08:30:12.233808 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":130,"threads_started":1}
I20260808 08:30:12.237455 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:30:12.237836 31723 raft_consensus.cc:348] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43101 } }
I20260808 08:30:12.238057 31723 raft_consensus.cc:374] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:12.238129 31723 raft_consensus.cc:729] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d46a9f1d9e9a4f84a0b34d8285340f8a, State: Initialized, Role: FOLLOWER
I20260808 08:30:12.238586 31723 consensus_queue.cc:260] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43101 } }
I20260808 08:30:12.238746 31723 raft_consensus.cc:388] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:12.238821 31723 raft_consensus.cc:482] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:12.238917 31723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:12.239820 31723 raft_consensus.cc:504] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43101 } }
I20260808 08:30:12.240162 31723 leader_election.cc:302] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d46a9f1d9e9a4f84a0b34d8285340f8a; no voters:
I20260808 08:30:12.240409 31723 leader_election.cc:288] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:12.240540 31728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:12.240763 31728 raft_consensus.cc:686] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [term 1 LEADER]: Becoming Leader. State: Replica: d46a9f1d9e9a4f84a0b34d8285340f8a, State: Running, Role: LEADER
I20260808 08:30:12.241076 31728 consensus_queue.cc:237] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43101 } }
I20260808 08:30:12.241559 31723 sys_catalog.cc:564] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:12.242700 31730 sys_catalog.cc:455] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d46a9f1d9e9a4f84a0b34d8285340f8a. Latest consensus state: current_term: 1 leader_uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43101 } } }
I20260808 08:30:12.242835 31730 sys_catalog.cc:458] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:12.243119 31729 sys_catalog.cc:455] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46a9f1d9e9a4f84a0b34d8285340f8a" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43101 } } }
I20260808 08:30:12.243232 31729 sys_catalog.cc:458] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a [sys.catalog]: This master's current role is: LEADER
W20260808 08:30:12.246488 31743 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:30:12.246568 31743 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:30:12.246632 31737 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:12.247267 31737 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:12.252389 31737 catalog_manager.cc:1347] Generated new cluster ID: f7b9cfb54a4a49c48011bfc311ce15de
I20260808 08:30:12.252449 31737 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:12.263811 31737 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:12.264958 31737 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:12.285629 31737 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d46a9f1d9e9a4f84a0b34d8285340f8a: Generated new TSK 0
I20260808 08:30:12.286325 31737 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 08:30:12.317664 31754 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 08:30:12.317780 31754 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 08:30:12.318351 31726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:12.300053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32790 (local address 127.25.170.62:43101)
0808 08:30:12.300182 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:12.300186 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:12.300399 (+ 213us) server_negotiation.cc:407] Connection header received
0808 08:30:12.300629 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:12.300632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:12.300689 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:12.300785 (+ 96us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:30:12.301061 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.301607 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.302479 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.302733 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.302841 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:12.303183 (+ 342us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:30:12.317957 (+ 14774us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37943/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 08:30:12.318204 (+ 247us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:32790: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37943/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 08:30:12.318440 31726 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:32790: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37943/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 08:30:12.319517 31753 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:12.299981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:43101 (local address 127.0.0.1:32790)
0808 08:30:12.300309 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:12.300321 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:12.300477 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:12.300802 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:12.300805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:12.300813 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:30:12.300935 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:12.300941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.301720 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.301724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:12.302358 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:12.302364 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.302851 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.302855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:12.302957 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:12.302999 (+ 42us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:30:12.318154 (+ 15155us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37943/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 08:30:12.318386 (+ 232us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.170.62:43101: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37943/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":129,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.25.170.62:43101: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37943/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 08:30:12.320200 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 31655
2026-08-08T08:30:12Z chronyd exiting
I20260808 08:30:12.360209 26280 test_util.cc:175] -----------------------------------------------
I20260808 08:30:12.360309 26280 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786177786507378-26280-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (335 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 08:30:12.361387 26280 mini_oidc.cc:152] Starting JWKS server
I20260808 08:30:12.362239 26280 webserver.cc:460] Webserver started at https://127.0.0.1:33389/ using document root <none> and password file <none>
I20260808 08:30:12.362360 26280 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:30:12.362643 26280 webserver.cc:460] Webserver started at http://127.0.0.1:37605/ using document root <none> and password file <none>
2026-08-08T08:30:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:12Z Disabled control of system clock
I20260808 08:30:12.372555 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40003
--webserver_interface=127.25.170.62
--webserver_port=0
--builtin_ntp_servers=127.25.170.20:42157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:40003
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33389/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/testchainca.cert with env {}
W20260808 08:30:12.485134 31760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:12.485368 31760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:12.485404 31760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:12.489342 31760 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:12.489389 31760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:12.489405 31760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:12.489421 31760 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:12.489436 31760 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:30:12.489456 31760 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:30:12.489475 31760 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33389/jwks.json
I20260808 08:30:12.494498 31760 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:40003
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33389/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:12.495368 31760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:12.496322 31760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:12.504278 31765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:12.504287 31766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:12.504518 31768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:12.504967 31760 server_base.cc:1034] running on GCE node
I20260808 08:30:12.505517 31760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:12.506573 31760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:12.507730 31760 hybrid_clock.cc:648] HybridClock initialized: now 1786177812507700 us; error 44 us; skew 500 ppm
I20260808 08:30:12.509529 31760 webserver.cc:460] Webserver started at http://127.25.170.62:37939/ using document root <none> and password file <none>
I20260808 08:30:12.510088 31760 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:12.510150 31760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:12.510371 31760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:12.512423 31760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "20eb21632e9542b8adbcc177e971eaf1"
format_stamp: "Formatted at 2026-08-08 08:30:12 on dist-test-slave-zkpd"
server_key: "087fdbc1bb5bd6134d04a0deb74e5de9"
server_key_iv: "bffd319149b6c03c97c66f5307140bcc"
server_key_version: "encryptionkey@0"
I20260808 08:30:12.512982 31760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "20eb21632e9542b8adbcc177e971eaf1"
format_stamp: "Formatted at 2026-08-08 08:30:12 on dist-test-slave-zkpd"
server_key: "087fdbc1bb5bd6134d04a0deb74e5de9"
server_key_iv: "bffd319149b6c03c97c66f5307140bcc"
server_key_version: "encryptionkey@0"
I20260808 08:30:12.516453 31760 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:30:12.518750 31775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:12.519946 31760 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:12.520073 31760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "20eb21632e9542b8adbcc177e971eaf1"
format_stamp: "Formatted at 2026-08-08 08:30:12 on dist-test-slave-zkpd"
server_key: "087fdbc1bb5bd6134d04a0deb74e5de9"
server_key_iv: "bffd319149b6c03c97c66f5307140bcc"
server_key_version: "encryptionkey@0"
I20260808 08:30:12.520177 31760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:12.540714 31760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:12.541352 31760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:12.541535 31760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:12.548400 31760 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:40003
I20260808 08:30:12.548414 31829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:40003 every 8 connection(s)
I20260808 08:30:12.549310 31760 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:12.552224 31830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:12.557475 31830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1: Bootstrap starting.
I20260808 08:30:12.558065 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 31760
I20260808 08:30:12.558211 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:12.558475 26280 external_mini_cluster.cc:1428] Setting key 2255f1eb9171fc39672e8af49d6477c3
I20260808 08:30:12.560354 31830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:12.561225 31830 log.cc:824] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:12.563469 31830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1: No bootstrap required, opened a new log
I20260808 08:30:12.568049 31830 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20eb21632e9542b8adbcc177e971eaf1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40003 } }
I20260808 08:30:12.568310 31830 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:12.568369 31830 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20eb21632e9542b8adbcc177e971eaf1, State: Initialized, Role: FOLLOWER
I20260808 08:30:12.568815 31833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:12.559813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57472 (local address 127.25.170.62:40003)
0808 08:30:12.560559 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:12.560583 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:12.560632 (+ 49us) server_negotiation.cc:407] Connection header received
0808 08:30:12.561461 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:12.561486 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:12.561891 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:12.562238 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:12.562687 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.564133 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.565024 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.565714 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.565886 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:12.566664 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:12.566672 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:12.566690 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:12.567284 (+ 594us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:12.567365 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:12.567392 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:12.567493 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:12.567590 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 08:30:12.567850 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":98,"threads_started":1}
I20260808 08:30:12.568845 31830 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20eb21632e9542b8adbcc177e971eaf1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40003 } }
I20260808 08:30:12.568984 31830 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:12.569051 31830 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:12.569150 31830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:12.570104 31830 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20eb21632e9542b8adbcc177e971eaf1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40003 } }
I20260808 08:30:12.570474 31830 leader_election.cc:302] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20eb21632e9542b8adbcc177e971eaf1; no voters:
I20260808 08:30:12.570822 31830 leader_election.cc:288] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:12.570952 31835 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:12.571204 31835 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [term 1 LEADER]: Becoming Leader. State: Replica: 20eb21632e9542b8adbcc177e971eaf1, State: Running, Role: LEADER
I20260808 08:30:12.571511 31835 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20eb21632e9542b8adbcc177e971eaf1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40003 } }
I20260808 08:30:12.571837 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:30:12.572141 31830 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:12.572688 31837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20eb21632e9542b8adbcc177e971eaf1. Latest consensus state: current_term: 1 leader_uuid: "20eb21632e9542b8adbcc177e971eaf1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20eb21632e9542b8adbcc177e971eaf1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40003 } } }
I20260808 08:30:12.572824 31837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:12.573112 31836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20eb21632e9542b8adbcc177e971eaf1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20eb21632e9542b8adbcc177e971eaf1" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40003 } } }
I20260808 08:30:12.573195 31836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1 [sys.catalog]: This master's current role is: LEADER
W20260808 08:30:12.577189 31850 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:30:12.577270 31850 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:30:12.577354 31840 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:12.578181 31840 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:12.583454 31840 catalog_manager.cc:1347] Generated new cluster ID: 89b6b3a4caa64d04918f5977d38a644f
I20260808 08:30:12.583518 31840 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:12.594494 31840 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:12.595571 31840 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:12.602062 31840 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20eb21632e9542b8adbcc177e971eaf1: Generated new TSK 0
I20260808 08:30:12.602718 31840 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 08:30:12.633757 31860 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 08:30:12.633837 31860 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 08:30:12.634398 31833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:12.618204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57480 (local address 127.25.170.62:40003)
0808 08:30:12.618334 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:12.618339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:12.618519 (+ 180us) server_negotiation.cc:407] Connection header received
0808 08:30:12.618671 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:12.618673 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:12.618716 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:12.618815 (+ 99us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:30:12.619061 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.619572 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.620815 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.621036 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.621124 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:12.621458 (+ 334us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:30:12.634113 (+ 12655us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 08:30:12.634302 (+ 189us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57480: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 08:30:12.634470 31833 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57480: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 08:30:12.634624 31859 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:12.618127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40003 (local address 127.0.0.1:57480)
0808 08:30:12.618431 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:12.618447 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:12.618560 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:12.618833 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:12.618836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:12.618844 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:30:12.618960 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:12.618966 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.619678 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.619681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:12.620691 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:12.620702 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.621157 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.621161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:12.621253 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:12.621281 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:30:12.634269 (+ 12988us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 08:30:12.634447 (+ 178us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.170.62:40003: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33389/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":117,"threads_started":1}
I20260808 08:30:12.635393 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 31760
2026-08-08T08:30:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (315 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 08:30:12.677278 26280 mini_oidc.cc:152] Starting JWKS server
I20260808 08:30:12.678122 26280 webserver.cc:460] Webserver started at https://127.0.0.1:40465/ using document root <none> and password file <none>
I20260808 08:30:12.678233 26280 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:30:12.678454 26280 webserver.cc:460] Webserver started at http://127.0.0.1:34321/ using document root <none> and password file <none>
2026-08-08T08:30:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:12Z Disabled control of system clock
I20260808 08:30:12.688064 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39585
--webserver_interface=127.25.170.62
--webserver_port=0
--builtin_ntp_servers=127.25.170.20:42741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:39585
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40465/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 08:30:12.796666 31866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:12.796936 31866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:12.797013 31866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:12.800899 31866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:12.800971 31866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:12.800999 31866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:12.801046 31866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:12.801079 31866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:30:12.801110 31866 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:30:12.801139 31866 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40465/jwks.json
I20260808 08:30:12.805809 31866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:39585
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40465/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:12.806782 31866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:12.808085 31866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:12.816066 31871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:12.816207 31866 server_base.cc:1034] running on GCE node
W20260808 08:30:12.816146 31874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:12.816066 31872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:12.816870 31866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:12.817934 31866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:12.819109 31866 hybrid_clock.cc:648] HybridClock initialized: now 1786177812819082 us; error 41 us; skew 500 ppm
I20260808 08:30:12.820990 31866 webserver.cc:460] Webserver started at http://127.25.170.62:34723/ using document root <none> and password file <none>
I20260808 08:30:12.821550 31866 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:12.821640 31866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:12.821875 31866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:12.823880 31866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "8a94dab3b9c84471ae2d66c0222b3576"
format_stamp: "Formatted at 2026-08-08 08:30:12 on dist-test-slave-zkpd"
server_key: "d091674334e0420863d2ccb256911a76"
server_key_iv: "bbb4f921eafe31620c61c153c87a9f72"
server_key_version: "encryptionkey@0"
I20260808 08:30:12.824502 31866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "8a94dab3b9c84471ae2d66c0222b3576"
format_stamp: "Formatted at 2026-08-08 08:30:12 on dist-test-slave-zkpd"
server_key: "d091674334e0420863d2ccb256911a76"
server_key_iv: "bbb4f921eafe31620c61c153c87a9f72"
server_key_version: "encryptionkey@0"
I20260808 08:30:12.828140 31866 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 08:30:12.830399 31880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:12.831579 31866 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:12.831719 31866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "8a94dab3b9c84471ae2d66c0222b3576"
format_stamp: "Formatted at 2026-08-08 08:30:12 on dist-test-slave-zkpd"
server_key: "d091674334e0420863d2ccb256911a76"
server_key_iv: "bbb4f921eafe31620c61c153c87a9f72"
server_key_version: "encryptionkey@0"
I20260808 08:30:12.831840 31866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:12.851603 31866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:12.852283 31866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:12.852465 31866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:12.859292 31866 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:39585
I20260808 08:30:12.859298 31936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:39585 every 8 connection(s)
I20260808 08:30:12.860342 31866 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:12.863128 31937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:12.863483 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 31866
I20260808 08:30:12.863626 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:12.863943 26280 external_mini_cluster.cc:1428] Setting key fabb4d691eca682249f8e6987cbb305c
I20260808 08:30:12.869809 31937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576: Bootstrap starting.
I20260808 08:30:12.872200 31937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:12.873019 31937 log.cc:824] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:12.873095 31940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:12.865314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48346 (local address 127.25.170.62:39585)
0808 08:30:12.866030 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:12.866047 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:12.866083 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:30:12.866742 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:12.866759 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:12.867159 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:12.867497 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:12.867971 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.868932 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.869810 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.870316 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.870483 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:12.871413 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:12.871418 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:12.871430 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:12.871805 (+ 375us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:12.871860 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:12.871879 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:12.872025 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:12.872172 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 08:30:12.872415 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":145,"threads_started":1}
I20260808 08:30:12.875083 31937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576: No bootstrap required, opened a new log
I20260808 08:30:12.876053 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:30:12.878962 31937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a94dab3b9c84471ae2d66c0222b3576" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39585 } }
I20260808 08:30:12.879205 31937 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:12.879292 31937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a94dab3b9c84471ae2d66c0222b3576, State: Initialized, Role: FOLLOWER
I20260808 08:30:12.879714 31937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a94dab3b9c84471ae2d66c0222b3576" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39585 } }
I20260808 08:30:12.879863 31937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:12.879969 31937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:12.880088 31937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:12.880932 31937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a94dab3b9c84471ae2d66c0222b3576" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39585 } }
I20260808 08:30:12.881263 31937 leader_election.cc:302] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a94dab3b9c84471ae2d66c0222b3576; no voters:
I20260808 08:30:12.881567 31937 leader_election.cc:288] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:12.881652 31942 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:12.881907 31942 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [term 1 LEADER]: Becoming Leader. State: Replica: 8a94dab3b9c84471ae2d66c0222b3576, State: Running, Role: LEADER
I20260808 08:30:12.882292 31942 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a94dab3b9c84471ae2d66c0222b3576" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39585 } }
I20260808 08:30:12.882802 31937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:12.884127 31944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a94dab3b9c84471ae2d66c0222b3576. Latest consensus state: current_term: 1 leader_uuid: "8a94dab3b9c84471ae2d66c0222b3576" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a94dab3b9c84471ae2d66c0222b3576" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39585 } } }
I20260808 08:30:12.884191 31943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a94dab3b9c84471ae2d66c0222b3576" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a94dab3b9c84471ae2d66c0222b3576" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39585 } } }
I20260808 08:30:12.884284 31943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:12.884284 31944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:12.885226 31953 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:12.887705 31953 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:12.892707 31953 catalog_manager.cc:1347] Generated new cluster ID: 5773ab7437864acc96e04019354ebc88
I20260808 08:30:12.892779 31953 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:12.904165 31953 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:12.905254 31953 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:12.923503 31953 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a94dab3b9c84471ae2d66c0222b3576: Generated new TSK 0
I20260808 08:30:12.924291 31953 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:30:12.943676 31940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:12.939340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48358 (local address 127.25.170.62:39585)
0808 08:30:12.939456 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:12.939460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:12.939470 (+ 10us) server_negotiation.cc:407] Connection header received
0808 08:30:12.939532 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:12.939534 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:12.939577 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:12.939687 (+ 110us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:30:12.939982 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.940522 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.941423 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.941688 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.941807 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:12.942117 (+ 310us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:30:12.943288 (+ 1171us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40465/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 08:30:12.943529 (+ 241us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48358: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40465/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":33}
W20260808 08:30:12.943756 31967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:12.938902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39585 (local address 127.0.0.1:48358)
0808 08:30:12.939171 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:12.939186 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:12.939287 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:12.939688 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:12.939692 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:12.939700 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:30:12.939840 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:12.939846 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.940637 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.940640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:12.941292 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:12.941299 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:12.941816 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:12.941820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:12.941915 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:12.941937 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:30:12.943450 (+ 1513us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40465/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 08:30:12.943601 (+ 151us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.170.62:39585: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40465/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":106,"threads_started":1}
I20260808 08:30:12.944089 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 31866
E20260808 08:30:12.959568 31968 webserver.cc:533] Webserver: sslize failed:
E20260808 08:30:12.959632 31968 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T08:30:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (310 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T08:30:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:12Z Disabled control of system clock
I20260808 08:30:12.997794 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:42723
--webserver_interface=127.25.170.62
--webserver_port=0
--builtin_ntp_servers=127.25.170.20:38771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:42723
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/testchainca.cert with env {}
W20260808 08:30:13.107745 31972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:13.108016 31972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:13.108079 31972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:13.111974 31972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:13.112018 31972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:13.112033 31972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:13.112088 31972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:13.112123 31972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:30:13.112154 31972 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:30:13.112185 31972 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 08:30:13.117345 31972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:42723
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:42723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:13.118299 31972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:13.119249 31972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:13.127956 31977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:13.127956 31978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:13.127996 31980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:13.128322 31972 server_base.cc:1034] running on GCE node
I20260808 08:30:13.128830 31972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:13.129798 31972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:13.130950 31972 hybrid_clock.cc:648] HybridClock initialized: now 1786177813130923 us; error 40 us; skew 500 ppm
I20260808 08:30:13.132720 31972 webserver.cc:460] Webserver started at http://127.25.170.62:42441/ using document root <none> and password file <none>
I20260808 08:30:13.133291 31972 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:13.133352 31972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:13.133507 31972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:13.135437 31972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "c3b850eb5b66428fb13bc36509cbc151"
format_stamp: "Formatted at 2026-08-08 08:30:13 on dist-test-slave-zkpd"
server_key: "af6199ac1a41c404fd28703c303ac9d1"
server_key_iv: "e4a055c5186a4b9b79f3ea1c5c8fbe1f"
server_key_version: "encryptionkey@0"
I20260808 08:30:13.136009 31972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "c3b850eb5b66428fb13bc36509cbc151"
format_stamp: "Formatted at 2026-08-08 08:30:13 on dist-test-slave-zkpd"
server_key: "af6199ac1a41c404fd28703c303ac9d1"
server_key_iv: "e4a055c5186a4b9b79f3ea1c5c8fbe1f"
server_key_version: "encryptionkey@0"
I20260808 08:30:13.139408 31972 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:30:13.141671 31986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:13.142827 31972 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:13.142956 31972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "c3b850eb5b66428fb13bc36509cbc151"
format_stamp: "Formatted at 2026-08-08 08:30:13 on dist-test-slave-zkpd"
server_key: "af6199ac1a41c404fd28703c303ac9d1"
server_key_iv: "e4a055c5186a4b9b79f3ea1c5c8fbe1f"
server_key_version: "encryptionkey@0"
I20260808 08:30:13.143054 31972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:13.155649 31972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:13.156319 31972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:13.156495 31972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:13.163348 32039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:42723 every 8 connection(s)
I20260808 08:30:13.163357 31972 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:42723
I20260808 08:30:13.164388 31972 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:13.167290 32041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:13.172953 32041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151: Bootstrap starting.
I20260808 08:30:13.173532 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 31972
I20260808 08:30:13.173626 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:13.173938 26280 external_mini_cluster.cc:1428] Setting key 854bb386306bee2ed7025a161a10e3fb
I20260808 08:30:13.175783 32041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:13.176623 32041 log.cc:824] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:13.178715 32041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151: No bootstrap required, opened a new log
I20260808 08:30:13.183063 32041 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b850eb5b66428fb13bc36509cbc151" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42723 } }
I20260808 08:30:13.183296 32041 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:13.183372 32041 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b850eb5b66428fb13bc36509cbc151, State: Initialized, Role: FOLLOWER
I20260808 08:30:13.183560 32044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:13.175199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35558 (local address 127.25.170.62:42723)
0808 08:30:13.176042 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:13.176062 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:13.176102 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:30:13.176814 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:13.176838 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:13.177296 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:13.177588 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:13.177938 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:13.179047 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:13.180332 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:13.180794 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:13.180914 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:13.181812 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:13.181816 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:13.181829 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:13.182182 (+ 353us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:13.182231 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:13.182250 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:13.182325 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:13.182489 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 08:30:13.182785 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":117,"threads_started":1}
I20260808 08:30:13.183871 32041 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b850eb5b66428fb13bc36509cbc151" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42723 } }
I20260808 08:30:13.184074 32041 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:13.184141 32041 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:13.184237 32041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:13.185159 32041 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b850eb5b66428fb13bc36509cbc151" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42723 } }
I20260808 08:30:13.185523 32041 leader_election.cc:302] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3b850eb5b66428fb13bc36509cbc151; no voters:
I20260808 08:30:13.185875 32041 leader_election.cc:288] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:13.185945 32046 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:13.186143 32046 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [term 1 LEADER]: Becoming Leader. State: Replica: c3b850eb5b66428fb13bc36509cbc151, State: Running, Role: LEADER
I20260808 08:30:13.186493 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:30:13.187155 32041 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:13.187493 32046 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b850eb5b66428fb13bc36509cbc151" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42723 } }
I20260808 08:30:13.189569 32048 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3b850eb5b66428fb13bc36509cbc151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b850eb5b66428fb13bc36509cbc151" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42723 } } }
I20260808 08:30:13.189654 32048 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:13.189397 32047 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3b850eb5b66428fb13bc36509cbc151. Latest consensus state: current_term: 1 leader_uuid: "c3b850eb5b66428fb13bc36509cbc151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b850eb5b66428fb13bc36509cbc151" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 42723 } } }
I20260808 08:30:13.189906 32047 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151 [sys.catalog]: This master's current role is: LEADER
W20260808 08:30:13.191869 32060 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:30:13.191993 32060 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:30:13.192065 32061 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:13.192785 32061 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:13.198299 32061 catalog_manager.cc:1347] Generated new cluster ID: 8184b09ccf5c41e99eb99e7656ae593a
I20260808 08:30:13.198374 32061 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:13.210657 32061 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:13.211781 32061 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:13.217716 32061 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3b850eb5b66428fb13bc36509cbc151: Generated new TSK 0
I20260808 08:30:13.218389 32061 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:30:13.649891 32044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:13.225770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35572 (local address 127.25.170.62:42723)
0808 08:30:13.225895 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:13.225900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:13.226074 (+ 174us) server_negotiation.cc:407] Connection header received
0808 08:30:13.226202 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:13.226206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:13.226259 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:13.226367 (+ 108us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:30:13.226574 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:13.227387 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:13.228302 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:13.228647 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:13.228749 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:13.229030 (+ 281us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:30:13.649477 (+420447us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 08:30:13.649753 (+ 276us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35572: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 08:30:13.649967 32044 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35572: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 08:30:13.650418 32070 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:13.225668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:42723 (local address 127.0.0.1:35572)
0808 08:30:13.225995 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:13.226008 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:13.226100 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:13.226373 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:13.226375 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:13.226381 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:30:13.226477 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:13.226481 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:13.227515 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:13.227518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:13.228196 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:13.228205 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:13.228779 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:13.228781 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:13.228851 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:13.228874 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:30:13.649739 (+420865us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 08:30:13.649925 (+ 186us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.170.62:42723: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":130,"threads_started":1}
I20260808 08:30:13.651077 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 31972
2026-08-08T08:30:13Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (684 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (122 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (122 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:13 dist-test-slave-zkpd krb5kdc[32082](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:13 dist-test-slave-zkpd krb5kdc[32082](info): set up 2 sockets
Aug 08 08:30:13 dist-test-slave-zkpd krb5kdc[32082](info): commencing operation
krb5kdc: starting...
W20260808 08:30:15.032348 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:15 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:30:15.158149 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:44949
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:44949
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:15.268329 32095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:15.268569 32095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:15.268608 32095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:15.272522 32095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:15.272571 32095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:15.272590 32095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:15.272607 32095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:15.272650 32095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:15.278087 32095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:44949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:44949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:15.279107 32095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:15.280125 32095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:15.288599 32101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:15.288623 32102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:15.288631 32104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:15.288822 32095 server_base.cc:1034] running on GCE node
I20260808 08:30:15.289476 32095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:15.290452 32095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:15.291638 32095 hybrid_clock.cc:648] HybridClock initialized: now 1786177815291616 us; error 44 us; skew 500 ppm
Aug 08 08:30:15 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177815, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:15.297539 32095 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:30:15.298437 32095 webserver.cc:460] Webserver started at http://127.25.170.62:45607/ using document root <none> and password file <none>
I20260808 08:30:15.298993 32095 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:15.299079 32095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:15.299301 32095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:15.301290 32095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "bdedb01b84b9454198b0d25409807992"
format_stamp: "Formatted at 2026-08-08 08:30:15 on dist-test-slave-zkpd"
server_key: "575e0e2a608b4f6ff44ba4cb0d4b8874"
server_key_iv: "53dad8cc91e373a528cae0ff3c12a56e"
server_key_version: "encryptionkey@0"
I20260808 08:30:15.301858 32095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "bdedb01b84b9454198b0d25409807992"
format_stamp: "Formatted at 2026-08-08 08:30:15 on dist-test-slave-zkpd"
server_key: "575e0e2a608b4f6ff44ba4cb0d4b8874"
server_key_iv: "53dad8cc91e373a528cae0ff3c12a56e"
server_key_version: "encryptionkey@0"
I20260808 08:30:15.305469 32095 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:30:15.307704 32111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:15.308897 32095 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:15.309031 32095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "bdedb01b84b9454198b0d25409807992"
format_stamp: "Formatted at 2026-08-08 08:30:15 on dist-test-slave-zkpd"
server_key: "575e0e2a608b4f6ff44ba4cb0d4b8874"
server_key_iv: "53dad8cc91e373a528cae0ff3c12a56e"
server_key_version: "encryptionkey@0"
I20260808 08:30:15.309135 32095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:15.328608 32095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:15.331209 32095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:15.331404 32095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:15.338863 32095 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:44949
I20260808 08:30:15.338884 32168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:44949 every 8 connection(s)
I20260808 08:30:15.339757 32095 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:15.342374 32169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:15.344249 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 32095
I20260808 08:30:15.344388 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:15.344650 26280 external_mini_cluster.cc:1428] Setting key 7d7424004aa16545de618ee12761a25e
I20260808 08:30:15.348237 32169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992: Bootstrap starting.
I20260808 08:30:15.350332 32169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:15.351059 32169 log.cc:824] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:15.353478 32169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992: No bootstrap required, opened a new log
Aug 08 08:30:15 dist-test-slave-zkpd krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:15.358156 32169 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdedb01b84b9454198b0d25409807992" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44949 } }
I20260808 08:30:15.358418 32169 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:15.358485 32169 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdedb01b84b9454198b0d25409807992, State: Initialized, Role: FOLLOWER
I20260808 08:30:15.358981 32169 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdedb01b84b9454198b0d25409807992" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44949 } }
I20260808 08:30:15.359151 32169 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:15.359220 32169 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:15.359263 32172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:15.346065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55810 (local address 127.25.170.62:44949)
0808 08:30:15.346504 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:15.346523 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:15.346555 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:30:15.347352 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:15.347371 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:15.347703 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:15.348079 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:15.348898 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:15.349884 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:15.350789 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:15.351316 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:15.351478 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:15.354201 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:15.354207 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:15.354223 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:15.354253 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:15.356267 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:15.356693 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:15.356698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:15.356704 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:15.356838 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:15.357086 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:15.357089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:15.357091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:15.357600 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:15.357805 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:15.357980 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 08:30:15.358259 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":132,"threads_started":1}
I20260808 08:30:15.359323 32169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:15.360419 32169 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdedb01b84b9454198b0d25409807992" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44949 } }
I20260808 08:30:15.360746 32169 leader_election.cc:302] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdedb01b84b9454198b0d25409807992; no voters:
I20260808 08:30:15.361043 32169 leader_election.cc:288] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:15.361142 32174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:15.361343 32174 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [term 1 LEADER]: Becoming Leader. State: Replica: bdedb01b84b9454198b0d25409807992, State: Running, Role: LEADER
I20260808 08:30:15.361696 32174 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdedb01b84b9454198b0d25409807992" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44949 } }
I20260808 08:30:15.362205 32169 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:15.362775 32176 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdedb01b84b9454198b0d25409807992. Latest consensus state: current_term: 1 leader_uuid: "bdedb01b84b9454198b0d25409807992" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdedb01b84b9454198b0d25409807992" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44949 } } }
I20260808 08:30:15.362908 32176 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:15.363302 32175 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdedb01b84b9454198b0d25409807992" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdedb01b84b9454198b0d25409807992" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44949 } } }
I20260808 08:30:15.363412 32175 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:15.364768 32179 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:15.367453 32179 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:15.372871 32179 catalog_manager.cc:1347] Generated new cluster ID: e2747542697f4e3f946e0ea1652a5053
I20260808 08:30:15.372932 32179 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:15.383241 32179 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:15.384207 32179 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:15.391077 32179 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdedb01b84b9454198b0d25409807992: Generated new TSK 0
I20260808 08:30:15.391681 32179 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:30:15.430078 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:44949
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:15.545997 32195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:15.546231 32195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:15.546271 32195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:15.550091 32195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:15.550134 32195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:15.550189 32195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:15.555038 32195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:44949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:15.556020 32195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:15.556914 32195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:15.566097 32201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:15.566144 32202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:15.566236 32195 server_base.cc:1034] running on GCE node
W20260808 08:30:15.566098 32204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:15.566939 32195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:15.567469 32195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:15.568616 32195 hybrid_clock.cc:648] HybridClock initialized: now 1786177815568588 us; error 39 us; skew 500 ppm
Aug 08 08:30:15 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177815, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:15.571244 32195 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:30:15.572073 32195 webserver.cc:460] Webserver started at http://127.25.170.1:38935/ using document root <none> and password file <none>
I20260808 08:30:15.572624 32195 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:15.572710 32195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:15.572943 32195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:15.574889 32195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "d87d9a5459be477aa7f2ad1124ff7f01"
format_stamp: "Formatted at 2026-08-08 08:30:15 on dist-test-slave-zkpd"
server_key: "ea92036fe17ade76beecf50df7bd67aa"
server_key_iv: "4135095e1cd77fde3ebfa195ad74fbd3"
server_key_version: "encryptionkey@0"
I20260808 08:30:15.575476 32195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "d87d9a5459be477aa7f2ad1124ff7f01"
format_stamp: "Formatted at 2026-08-08 08:30:15 on dist-test-slave-zkpd"
server_key: "ea92036fe17ade76beecf50df7bd67aa"
server_key_iv: "4135095e1cd77fde3ebfa195ad74fbd3"
server_key_version: "encryptionkey@0"
I20260808 08:30:15.579061 32195 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:30:15.581384 32212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:15.582593 32195 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:15.582721 32195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "d87d9a5459be477aa7f2ad1124ff7f01"
format_stamp: "Formatted at 2026-08-08 08:30:15 on dist-test-slave-zkpd"
server_key: "ea92036fe17ade76beecf50df7bd67aa"
server_key_iv: "4135095e1cd77fde3ebfa195ad74fbd3"
server_key_version: "encryptionkey@0"
I20260808 08:30:15.582837 32195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:15.601359 32195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:15.604254 32195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:15.604462 32195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:15.605042 32195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:15.605860 32195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:15.605906 32195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:15.605970 32195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:15.606000 32195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:15.614593 32195 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:45919
I20260808 08:30:15.614661 32331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:45919 every 8 connection(s)
I20260808 08:30:15.615489 32195 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:15.616539 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 32195
I20260808 08:30:15.616680 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:15.616974 26280 external_mini_cluster.cc:1428] Setting key c0b82945cb50f45c94c6df27dd974d80
Aug 08 08:30:15 dist-test-slave-zkpd krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177815, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:30:15.630916 32172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:15.617450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:59023 (local address 127.25.170.62:44949)
0808 08:30:15.617605 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:15.617609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:15.618994 (+ 1385us) server_negotiation.cc:407] Connection header received
0808 08:30:15.620502 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:15.620506 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:15.620551 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:15.620629 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:15.622158 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:15.623025 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:15.624325 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:15.624770 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:15.624906 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:15.627374 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:15.627378 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:15.627381 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:15.627408 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:15.628925 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:15.629379 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:15.629381 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:15.629383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:15.629455 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:15.629755 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:15.629757 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:15.629758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:15.629975 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:15.630050 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:15.630579 (+ 529us) server_negotiation.cc:299] Negotiation successful
0808 08:30:15.630722 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:30:15.631886 32334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:15.617899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:44949 (local address 127.25.170.1:59023)
0808 08:30:15.618860 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:15.618900 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:15.620244 (+ 1344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:15.620820 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:15.620831 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:15.621339 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:15.622009 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:15.622024 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:15.623160 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:15.623163 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:15.624171 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:15.624181 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:15.624922 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:15.624924 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:15.625055 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:15.625753 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:15.625769 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:15.627189 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:15.629031 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:15.629035 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:15.629047 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:15.629297 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:15.629529 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:15.629531 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:15.629532 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:15.629654 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:15.630067 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:15.630072 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:15.630291 (+ 219us) client_negotiation.cc:769] Sending connection context
0808 08:30:15.630498 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 08:30:15.630791 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"thread_start_us":150,"threads_started":1}
I20260808 08:30:15.633060 32332 heartbeater.cc:347] Connected to a master server at 127.25.170.62:44949
I20260808 08:30:15.633332 32332 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:15.633818 32332 heartbeater.cc:511] Master 127.25.170.62:44949 requested a full tablet report, sending...
I20260808 08:30:15.635298 32130 ts_manager.cc:194] Registered new tserver with Master: d87d9a5459be477aa7f2ad1124ff7f01 (127.25.170.1:45919)
I20260808 08:30:15.636435 32130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:59023
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:30:15.646035 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:44949
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:15.756477 32337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:15.756700 32337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:15.756771 32337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:15.760739 32337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:15.760789 32337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:15.760905 32337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:15.766081 32337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:44949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:15.767004 32337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:15.767976 32337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:15.777100 32343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:15.777097 32342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:15.777097 32345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:15.777375 32337 server_base.cc:1034] running on GCE node
I20260808 08:30:15.777799 32337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:15.778405 32337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:15.779595 32337 hybrid_clock.cc:648] HybridClock initialized: now 1786177815779585 us; error 29 us; skew 500 ppm
Aug 08 08:30:15 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177815, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:15.782281 32337 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:30:15.783221 32337 webserver.cc:460] Webserver started at http://127.25.170.2:39735/ using document root <none> and password file <none>
I20260808 08:30:15.783757 32337 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:15.783850 32337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:15.784102 32337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:15.786168 32337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "088a1eef30ad4e19a3b633c50e82248f"
format_stamp: "Formatted at 2026-08-08 08:30:15 on dist-test-slave-zkpd"
server_key: "bd336f2751589a349661e6e764d52744"
server_key_iv: "6d69b51194b5fe15b12d2d7264d9f141"
server_key_version: "encryptionkey@0"
I20260808 08:30:15.786736 32337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "088a1eef30ad4e19a3b633c50e82248f"
format_stamp: "Formatted at 2026-08-08 08:30:15 on dist-test-slave-zkpd"
server_key: "bd336f2751589a349661e6e764d52744"
server_key_iv: "6d69b51194b5fe15b12d2d7264d9f141"
server_key_version: "encryptionkey@0"
I20260808 08:30:15.790299 32337 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 08:30:15.792603 32352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:15.793759 32337 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:30:15.793903 32337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "088a1eef30ad4e19a3b633c50e82248f"
format_stamp: "Formatted at 2026-08-08 08:30:15 on dist-test-slave-zkpd"
server_key: "bd336f2751589a349661e6e764d52744"
server_key_iv: "6d69b51194b5fe15b12d2d7264d9f141"
server_key_version: "encryptionkey@0"
I20260808 08:30:15.794008 32337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:15.814015 32337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:15.816704 32337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:15.816910 32337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:15.817464 32337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:15.818264 32337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:15.818339 32337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:15.818409 32337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:15.818451 32337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:15.827335 32337 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:36811
I20260808 08:30:15.827369 32471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:36811 every 8 connection(s)
I20260808 08:30:15.828226 32337 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:15.831875 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 32337
I20260808 08:30:15.832039 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:15.832297 26280 external_mini_cluster.cc:1428] Setting key 9719450d7b72b01ebc4bcccd4eff0d6e
Aug 08 08:30:15 dist-test-slave-zkpd krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177815, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:15.843808 32172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:15.829929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:53115 (local address 127.25.170.62:44949)
0808 08:30:15.830091 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:15.830096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:15.830937 (+ 841us) server_negotiation.cc:407] Connection header received
0808 08:30:15.832575 (+ 1638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:15.832579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:15.832645 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:15.832739 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:15.834163 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:15.834985 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:15.836292 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:15.836543 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:15.836670 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:15.839674 (+ 3004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:15.839677 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:15.839679 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:15.839704 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:15.841613 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:15.842142 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:15.842148 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:15.842151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:15.842254 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:15.842609 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:15.842615 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:15.842619 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:15.842863 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:15.842974 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:15.843474 (+ 500us) server_negotiation.cc:299] Negotiation successful
0808 08:30:15.843618 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:30:15.844568 32474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:15.830242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:44949 (local address 127.25.170.2:53115)
0808 08:30:15.830776 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:15.830821 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:15.832311 (+ 1490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:15.832998 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:15.833012 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:15.833402 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:15.834008 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:15.834024 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:15.835121 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:15.835124 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:15.836151 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:15.836162 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:15.836751 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:15.836759 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:15.836926 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:15.837545 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:15.837561 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:15.839499 (+ 1938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:15.841746 (+ 2247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:15.841751 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:15.841763 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:15.842038 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:15.842355 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:15.842358 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:15.842359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:15.842502 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:15.842974 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:15.842979 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:15.843199 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 08:30:15.843378 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 08:30:15.843619 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":124,"threads_started":1}
I20260808 08:30:15.845867 32472 heartbeater.cc:347] Connected to a master server at 127.25.170.62:44949
I20260808 08:30:15.846143 32472 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:15.846812 32472 heartbeater.cc:511] Master 127.25.170.62:44949 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
I20260808 08:30:15.847930 32130 ts_manager.cc:194] Registered new tserver with Master: 088a1eef30ad4e19a3b633c50e82248f (127.25.170.2:36811)
I20260808 08:30:15.848560 32130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:53115
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:30:15.863189 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:44949
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:15.981510 32477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:15.981741 32477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:15.981782 32477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:15.986110 32477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:15.986171 32477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:15.986229 32477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:15.992666 32477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:44949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:15.993673 32477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:15.994702 32477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:16.004770 32483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:16.004774 32485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:16.004861 32482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:16.004956 32477 server_base.cc:1034] running on GCE node
I20260808 08:30:16.005537 32477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:16.006146 32477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:16.007332 32477 hybrid_clock.cc:648] HybridClock initialized: now 1786177816007323 us; error 33 us; skew 500 ppm
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:16.010066 32477 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:30:16.010885 32477 webserver.cc:460] Webserver started at http://127.25.170.3:42715/ using document root <none> and password file <none>
I20260808 08:30:16.011448 32477 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:16.011538 32477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:16.011768 32477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:16.013942 32477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "5ed2dbcb17df4b6da918fbeeddd81c66"
format_stamp: "Formatted at 2026-08-08 08:30:16 on dist-test-slave-zkpd"
server_key: "c239966b3389c8a70036c2a93ae28779"
server_key_iv: "befb1efed1c74e267617fa26246f3134"
server_key_version: "encryptionkey@0"
I20260808 08:30:16.014511 32477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "5ed2dbcb17df4b6da918fbeeddd81c66"
format_stamp: "Formatted at 2026-08-08 08:30:16 on dist-test-slave-zkpd"
server_key: "c239966b3389c8a70036c2a93ae28779"
server_key_iv: "befb1efed1c74e267617fa26246f3134"
server_key_version: "encryptionkey@0"
I20260808 08:30:16.018115 32477 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:30:16.020463 32492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:16.021565 32477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:16.021706 32477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "5ed2dbcb17df4b6da918fbeeddd81c66"
format_stamp: "Formatted at 2026-08-08 08:30:16 on dist-test-slave-zkpd"
server_key: "c239966b3389c8a70036c2a93ae28779"
server_key_iv: "befb1efed1c74e267617fa26246f3134"
server_key_version: "encryptionkey@0"
I20260808 08:30:16.021824 32477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:16.034554 32477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:16.037284 32477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:16.037477 32477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:16.038045 32477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:16.038832 32477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:16.038903 32477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:16.038983 32477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:16.039028 32477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:16.047999 32477 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:34149
I20260808 08:30:16.048053 32609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:34149 every 8 connection(s)
I20260808 08:30:16.048893 32477 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:16.049629 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 32477
I20260808 08:30:16.049743 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:16.050047 26280 external_mini_cluster.cc:1428] Setting key e813bc4119a3e28d2a1ce88310c8ad53
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:16.061981 32172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:16.050802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:54139 (local address 127.25.170.62:44949)
0808 08:30:16.050950 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:16.050956 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:16.051928 (+ 972us) server_negotiation.cc:407] Connection header received
0808 08:30:16.053379 (+ 1451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:16.053382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:16.053426 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:16.053492 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:16.054552 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:16.055061 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:16.056256 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:16.056471 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:16.056551 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:16.058837 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:16.058841 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:16.058843 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:16.058863 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:16.060223 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:16.060667 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:16.060669 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:16.060671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:16.060744 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:16.061042 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:16.061045 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:16.061045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:16.061207 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:16.061284 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:16.061765 (+ 481us) server_negotiation.cc:299] Negotiation successful
0808 08:30:16.061864 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:30:16.062855 32612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:16.051221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:44949 (local address 127.25.170.3:54139)
0808 08:30:16.051762 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:16.051815 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:16.053185 (+ 1370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:16.053618 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:16.053624 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:16.053970 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:16.054433 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:16.054446 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:16.055163 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:16.055165 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:16.056152 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:16.056162 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:16.056592 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:16.056595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:16.056724 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:16.057321 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:16.057336 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:16.058695 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:16.060325 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:16.060330 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:16.060341 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:16.060583 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:16.060821 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:16.060823 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:16.060825 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:16.060949 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:16.061304 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:16.061309 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:16.061515 (+ 206us) client_negotiation.cc:769] Sending connection context
0808 08:30:16.061686 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 08:30:16.061956 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":168,"threads_started":1}
I20260808 08:30:16.063997 32610 heartbeater.cc:347] Connected to a master server at 127.25.170.62:44949
I20260808 08:30:16.064247 32610 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:16.064725 32610 heartbeater.cc:511] Master 127.25.170.62:44949 requested a full tablet report, sending...
I20260808 08:30:16.065728 32130 ts_manager.cc:194] Registered new tserver with Master: 5ed2dbcb17df4b6da918fbeeddd81c66 (127.25.170.3:34149)
I20260808 08:30:16.066294 32130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:54139
I20260808 08:30:16.075752 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/test-admin.keytab.
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:16.092862 26280 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 08:30:16.095552 32617 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:16.094191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39958 (local address 127.25.170.1:45919)
0808 08:30:16.094500 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:16.094514 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:16.094539 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:30:16.094590 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:16.094596 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:16.094784 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:16.094906 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:16.095371 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39958: BlockingRecv error: recv got EOF from 127.0.0.1:39958 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":110,"threads_started":1}
W20260808 08:30:16.095587 26280 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:16.097020 26280 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:16.098003 26280 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:30:16.107853 32617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:16.098827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39974 (local address 127.25.170.1:45919)
0808 08:30:16.098969 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:16.098973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:16.099052 (+ 79us) server_negotiation.cc:407] Connection header received
0808 08:30:16.099150 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:16.099153 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:16.099192 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:16.099258 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:16.099768 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:16.100621 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:16.101439 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:16.101809 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:16.101940 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:16.104266 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:16.104282 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:16.104295 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:16.104318 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:16.106026 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:16.106577 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:16.106581 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:16.106583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:16.106660 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:16.106947 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:16.106949 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:16.106950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:16.107183 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:16.107351 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:16.107512 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 08:30:16.107673 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 08:30:16.111651 32617 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:16.110735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39988 (local address 127.25.170.1:45919)
0808 08:30:16.110854 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:16.110857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:16.110983 (+ 126us) server_negotiation.cc:407] Connection header received
0808 08:30:16.111077 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:16.111079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:16.111113 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:16.111174 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:16.111551 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39988: BlockingRecv error: recv got EOF from 127.0.0.1:39988 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 08:30:16.111740 26280 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:16.112952 26280 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:16.113924 26280 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:30:16.122015 32617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:16.114727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39992 (local address 127.25.170.1:45919)
0808 08:30:16.114874 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:16.114877 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:16.114956 (+ 79us) server_negotiation.cc:407] Connection header received
0808 08:30:16.115055 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:16.115057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:16.115090 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:16.115151 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:16.115613 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:16.116175 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:16.116934 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:16.117146 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:16.117222 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:16.119227 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:16.119229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:16.119231 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:16.119252 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:16.120633 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:16.120998 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:16.121000 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:16.121001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:16.121071 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:16.121303 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:16.121305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:16.121306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:16.121444 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:16.121534 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:16.121730 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 08:30:16.121840 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 08:30:16.124402 32617 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:16.123555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39994 (local address 127.25.170.1:45919)
0808 08:30:16.123688 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:16.123691 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:16.123706 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:30:16.123812 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:16.123814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:16.123847 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:16.123963 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:16.124307 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39994: BlockingRecv error: recv got EOF from 127.0.0.1:39994 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 08:30:16.124495 26280 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786177786507378-26280-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:16.125525 26280 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:16.126401 26280 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:30:16.134735 32617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:16.127120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40004 (local address 127.25.170.1:45919)
0808 08:30:16.127241 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:16.127245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:16.127359 (+ 114us) server_negotiation.cc:407] Connection header received
0808 08:30:16.127495 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:16.127498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:16.127536 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:16.127619 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:16.128141 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:16.128618 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:16.129388 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:16.129613 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:16.129720 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:16.131820 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:16.131824 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:16.131826 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:16.131852 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:16.133186 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:16.133598 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:16.133601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:16.133603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:16.133679 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:16.133966 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:16.133970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:16.133971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:16.134128 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:16.134254 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:16.134491 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 08:30:16.134597 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:30:16.135785 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 32195
I20260808 08:30:16.144174 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 32337
I20260808 08:30:16.153119 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 32477
I20260808 08:30:16.159876 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 32095
2026-08-08T08:30:16Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2263 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32630](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32630](info): set up 2 sockets
Aug 08 08:30:16 dist-test-slave-zkpd krb5kdc[32630](info): commencing operation
krb5kdc: starting...
W20260808 08:30:17.217856 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:17 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.62.keytab.
Entry for principal oryx/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.62.keytab.
I20260808 08:30:17.342031 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:38023
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.62.keytab
--principal=oryx/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:38023
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:17.452415 32643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:17.452661 32643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:17.452701 32643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:17.456583 32643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:17.456631 32643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:17.456650 32643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:17.456666 32643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:17.456681 32643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:17.464746 32643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:38023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.62.keytab
--principal=oryx/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:38023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:17.466048 32643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:17.467458 32643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:17.476101 32651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:17.476116 32648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:17.476287 32643 server_base.cc:1034] running on GCE node
W20260808 08:30:17.476102 32649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:17.476927 32643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:17.478031 32643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:17.479195 32643 hybrid_clock.cc:648] HybridClock initialized: now 1786177817479170 us; error 35 us; skew 500 ppm
Aug 08 08:30:17 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:17.482035 32643 init.cc:377] Logged in from keytab as oryx/127.25.170.62@KRBTEST.COM (short username oryx)
I20260808 08:30:17.482910 32643 webserver.cc:460] Webserver started at http://127.25.170.62:35399/ using document root <none> and password file <none>
I20260808 08:30:17.483444 32643 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:17.483505 32643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:17.483752 32643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:17.485787 32643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "d6a55413268043de8f78d2056192f997"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "aca710d057d067ce2e25c4fd94a082ad"
server_key_iv: "6402205bdcf5448d7604c961a85cce74"
server_key_version: "encryptionkey@0"
I20260808 08:30:17.486366 32643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "d6a55413268043de8f78d2056192f997"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "aca710d057d067ce2e25c4fd94a082ad"
server_key_iv: "6402205bdcf5448d7604c961a85cce74"
server_key_version: "encryptionkey@0"
I20260808 08:30:17.490132 32643 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:30:17.492456 32658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:17.493625 32643 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:17.493782 32643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "d6a55413268043de8f78d2056192f997"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "aca710d057d067ce2e25c4fd94a082ad"
server_key_iv: "6402205bdcf5448d7604c961a85cce74"
server_key_version: "encryptionkey@0"
I20260808 08:30:17.493888 32643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:17.508415 32643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:17.511581 32643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:17.511791 32643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:17.518939 32643 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:38023
I20260808 08:30:17.519222 32711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:38023 every 8 connection(s)
I20260808 08:30:17.520187 32643 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:17.522979 32712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:17.527925 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 32643
I20260808 08:30:17.528064 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:17.528359 26280 external_mini_cluster.cc:1428] Setting key 868d3afa7dfa4de4040feed7be8aa887
I20260808 08:30:17.528609 32712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997: Bootstrap starting.
I20260808 08:30:17.530985 32712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:17.531947 32712 log.cc:824] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:17.534068 32712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997: No bootstrap required, opened a new log
Aug 08 08:30:17 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:17.538465 32712 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } }
I20260808 08:30:17.538708 32712 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:17.538779 32712 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6a55413268043de8f78d2056192f997, State: Initialized, Role: FOLLOWER
I20260808 08:30:17.539211 32712 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } }
I20260808 08:30:17.539376 32712 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:17.539453 32712 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:17.539561 32712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:17.540494 32712 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } }
I20260808 08:30:17.540856 32712 leader_election.cc:302] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6a55413268043de8f78d2056192f997; no voters:
I20260808 08:30:17.541167 32712 leader_election.cc:288] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:17.541285 32718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:17.541513 32718 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 1 LEADER]: Becoming Leader. State: Replica: d6a55413268043de8f78d2056192f997, State: Running, Role: LEADER
I20260808 08:30:17.541836 32718 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } }
I20260808 08:30:17.542415 32712 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:17.543068 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:17.529636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53594 (local address 127.25.170.62:38023)
0808 08:30:17.530057 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:17.530072 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:17.530107 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:30:17.530718 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:17.530735 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:17.531083 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:17.531373 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:17.532314 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:17.533453 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:17.534586 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:17.535028 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:17.535145 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:17.537847 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:17.537852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:17.537864 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:17.537890 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:17.539870 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:17.540333 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:17.540339 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:17.540344 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:17.540462 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:17.540777 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:17.540781 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:17.540782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:17.541279 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:17.541507 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:17.541796 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 08:30:17.542091 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":144,"threads_started":1}
I20260808 08:30:17.543018 32718 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6a55413268043de8f78d2056192f997. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } }
I20260808 08:30:17.543161 32718 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:17.543685 32727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:17.546499 32719 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } }
I20260808 08:30:17.546669 32719 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:17.546902 32727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:17.552922 32727 catalog_manager.cc:1347] Generated new cluster ID: d303f198102a4dac8eeb5770051d57da
I20260808 08:30:17.552996 32727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:17.565224 32727 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:17.566128 32727 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:17.586442 32727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997: Generated new TSK 0
I20260808 08:30:17.587257 32727 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab.
Entry for principal oryx/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab.
I20260808 08:30:17.622442 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38023
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab
--principal=oryx/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:17.732249 32740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:17.732474 32740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:17.732514 32740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:17.737340 32740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:17.737419 32740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:17.737509 32740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:17.745012 32740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab
--principal=oryx/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:17.746047 32740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:17.747068 32740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:17.757865 32745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:17.757913 32746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:17.758256 32748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:17.759320 32740 server_base.cc:1034] running on GCE node
I20260808 08:30:17.759742 32740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:17.760473 32740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:17.761731 32740 hybrid_clock.cc:648] HybridClock initialized: now 1786177817761686 us; error 58 us; skew 500 ppm
Aug 08 08:30:17 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:17.765723 32740 init.cc:377] Logged in from keytab as oryx/127.25.170.1@KRBTEST.COM (short username oryx)
I20260808 08:30:17.766592 32740 webserver.cc:460] Webserver started at http://127.25.170.1:44397/ using document root <none> and password file <none>
I20260808 08:30:17.767149 32740 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:17.767241 32740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:17.767472 32740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:17.769572 32740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "af744f21c2864b7d947853af3fe07036"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "a417183b78218aacbe83cd5c2b10b305"
server_key_iv: "2c1c75cb5af74a3654155a4d3eb417a6"
server_key_version: "encryptionkey@0"
I20260808 08:30:17.770136 32740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "af744f21c2864b7d947853af3fe07036"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "a417183b78218aacbe83cd5c2b10b305"
server_key_iv: "2c1c75cb5af74a3654155a4d3eb417a6"
server_key_version: "encryptionkey@0"
I20260808 08:30:17.774024 32740 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 08:30:17.776672 32755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:17.778012 32740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:30:17.778154 32740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "af744f21c2864b7d947853af3fe07036"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "a417183b78218aacbe83cd5c2b10b305"
server_key_iv: "2c1c75cb5af74a3654155a4d3eb417a6"
server_key_version: "encryptionkey@0"
I20260808 08:30:17.778266 32740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:17.791630 32740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:17.794324 32740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:17.794518 32740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:17.795078 32740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:17.795869 32740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:17.795991 32740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:17.796064 32740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:17.796115 32740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:17.804852 32740 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:38291
I20260808 08:30:17.804883 404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:38291 every 8 connection(s)
I20260808 08:30:17.805684 32740 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:17.808847 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 32740
I20260808 08:30:17.808990 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:17.809257 26280 external_mini_cluster.cc:1428] Setting key 8e3d3211520ba08694a9e776013a992f
Aug 08 08:30:17 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for oryx/127.25.170.2@KRBTEST.COM; defaulting to no policy
I20260808 08:30:17.820025 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:17.807310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:45105 (local address 127.25.170.62:38023)
0808 08:30:17.807473 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:17.807479 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:17.808392 (+ 913us) server_negotiation.cc:407] Connection header received
0808 08:30:17.809830 (+ 1438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:17.809833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:17.809880 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:17.809949 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:17.811164 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:17.812028 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:17.813136 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:17.813379 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:17.813491 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:17.816297 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:17.816299 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:17.816301 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:17.816325 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:17.817752 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:17.818384 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:17.818387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:17.818388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:17.818463 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:17.818849 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:17.818851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:17.818852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:17.819011 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:17.819084 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:17.819702 (+ 618us) server_negotiation.cc:299] Negotiation successful
0808 08:30:17.819849 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:30:17.820907 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:17.807685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.1:45105)
0808 08:30:17.808242 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:17.808285 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:17.809610 (+ 1325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:17.810125 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:17.810132 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:17.810546 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:17.811017 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:17.811030 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:17.812149 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:17.812151 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:17.813008 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:17.813017 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:17.813530 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:17.813534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:17.813726 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:17.814284 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:17.814300 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:17.816125 (+ 1825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:17.817882 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:17.817889 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:17.817907 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:17.818273 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:17.818562 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:17.818566 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:17.818570 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:17.818754 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:17.819128 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:17.819136 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:17.819465 (+ 329us) client_negotiation.cc:769] Sending connection context
0808 08:30:17.819671 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 08:30:17.820045 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":194,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.2@KRBTEST.COM" created.
I20260808 08:30:17.822149 405 heartbeater.cc:347] Connected to a master server at 127.25.170.62:38023
I20260808 08:30:17.822409 405 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:17.822896 405 heartbeater.cc:511] Master 127.25.170.62:38023 requested a full tablet report, sending...
I20260808 08:30:17.824378 32676 ts_manager.cc:194] Registered new tserver with Master: af744f21c2864b7d947853af3fe07036 (127.25.170.1:38291)
I20260808 08:30:17.825464 32676 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:45105
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab.
Entry for principal oryx/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab.
I20260808 08:30:17.836954 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38023
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab
--principal=oryx/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:17.950515 410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:17.950747 410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:17.950788 410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:17.954921 410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:17.954984 410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:17.955087 410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:17.961068 410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab
--principal=oryx/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:17.962080 410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:17.963122 410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:17.972512 415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:17.972540 416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:17.972522 419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:17.972901 410 server_base.cc:1034] running on GCE node
I20260808 08:30:17.973376 410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:17.974002 410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:17.975183 410 hybrid_clock.cc:648] HybridClock initialized: now 1786177817975162 us; error 40 us; skew 500 ppm
Aug 08 08:30:17 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:17.977849 410 init.cc:377] Logged in from keytab as oryx/127.25.170.2@KRBTEST.COM (short username oryx)
I20260808 08:30:17.978710 410 webserver.cc:460] Webserver started at http://127.25.170.2:43179/ using document root <none> and password file <none>
I20260808 08:30:17.979250 410 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:17.979348 410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:17.979588 410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:17.981712 410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "3cb869d6bbd16d2b6353ebadc0988377"
server_key_iv: "d6355aa16126e502cf3b238f41e788ec"
server_key_version: "encryptionkey@0"
I20260808 08:30:17.982353 410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "3cb869d6bbd16d2b6353ebadc0988377"
server_key_iv: "d6355aa16126e502cf3b238f41e788ec"
server_key_version: "encryptionkey@0"
I20260808 08:30:17.986101 410 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:30:17.988617 427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:17.989909 410 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:17.990026 410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "3cb869d6bbd16d2b6353ebadc0988377"
server_key_iv: "d6355aa16126e502cf3b238f41e788ec"
server_key_version: "encryptionkey@0"
I20260808 08:30:17.990125 410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:18.002074 410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:18.005409 410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:18.005604 410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:18.006225 410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:18.007038 410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:18.007085 410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.007149 410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:18.007184 410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.016010 410 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:36317
I20260808 08:30:18.016079 545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:36317 every 8 connection(s)
I20260808 08:30:18.016917 410 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:18.023137 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 410
I20260808 08:30:18.023276 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:18.023559 26280 external_mini_cluster.cc:1428] Setting key 169243fc91fb47014979c187eab2a95d
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:18.030923 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.018652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:48913 (local address 127.25.170.62:38023)
0808 08:30:18.018780 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.018786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.019522 (+ 736us) server_negotiation.cc:407] Connection header received
0808 08:30:18.021033 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.021036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.021102 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.021190 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.022344 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.022877 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.024296 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.024550 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.024688 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.027192 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.027195 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.027197 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.027219 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.028749 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.029248 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.029255 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.029259 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.029376 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.029693 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.029699 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.029703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.029955 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.030059 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.030528 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.030692 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:30:18.031623 548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.018963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.2:48913)
0808 08:30:18.019380 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.019421 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.020812 (+ 1391us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.021376 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.021383 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.021715 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.022194 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.022207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.023006 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.023009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.024162 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.024172 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.024731 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.024735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.024957 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.025593 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.025609 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.027024 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.028871 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.028876 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.028888 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.029143 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.029470 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.029473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.029474 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.029602 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.030060 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.030064 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.030279 (+ 215us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.030431 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.030761 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":106,"threads_started":1}
I20260808 08:30:18.032878 546 heartbeater.cc:347] Connected to a master server at 127.25.170.62:38023
I20260808 08:30:18.033144 546 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:18.033629 546 heartbeater.cc:511] Master 127.25.170.62:38023 requested a full tablet report, sending...
I20260808 08:30:18.034695 32676 ts_manager.cc:194] Registered new tserver with Master: e89c9dd6dc224ca3ab1d9ffb6a693112 (127.25.170.2:36317)
WARNING: no policy specified for oryx/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:30:18.035290 32676 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:48913
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab.
Entry for principal oryx/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab.
I20260808 08:30:18.052632 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38023
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab
--principal=oryx/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:18.164112 551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:18.164371 551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:18.164443 551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:18.168465 551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:18.168543 551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:18.168630 551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:18.174381 551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab
--principal=oryx/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:18.175289 551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:18.176288 551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:18.185822 557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:18.185969 551 server_base.cc:1034] running on GCE node
W20260808 08:30:18.185850 559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:18.185832 556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:18.186474 551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:18.187094 551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:18.188295 551 hybrid_clock.cc:648] HybridClock initialized: now 1786177818188274 us; error 25 us; skew 500 ppm
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:18.191001 551 init.cc:377] Logged in from keytab as oryx/127.25.170.3@KRBTEST.COM (short username oryx)
I20260808 08:30:18.191852 551 webserver.cc:460] Webserver started at http://127.25.170.3:36035/ using document root <none> and password file <none>
I20260808 08:30:18.192407 551 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:18.192467 551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:18.192626 551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:18.194623 551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "e93c9b9cccd0455585241fb367c1bf98"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "ad38d57a685420098b0c5ac523298f78"
server_key_iv: "31669f9b06a51a5d17e6121a244d00ea"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.195130 551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "e93c9b9cccd0455585241fb367c1bf98"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "ad38d57a685420098b0c5ac523298f78"
server_key_iv: "31669f9b06a51a5d17e6121a244d00ea"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.198921 551 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 08:30:18.201224 567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.202416 551 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:18.202557 551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "e93c9b9cccd0455585241fb367c1bf98"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "ad38d57a685420098b0c5ac523298f78"
server_key_iv: "31669f9b06a51a5d17e6121a244d00ea"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.202665 551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:18.213627 551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:18.216536 551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:18.216717 551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:18.217272 551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:18.218060 551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:18.218130 551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.218199 551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:18.218251 551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.227041 551 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:44223
I20260808 08:30:18.227080 684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:44223 every 8 connection(s)
I20260808 08:30:18.227872 551 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:18.228684 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 551
I20260808 08:30:18.228819 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:18.229169 26280 external_mini_cluster.cc:1428] Setting key 8712ff50427e0a23a12670ef0903a552
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:18.241006 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.229891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:57807 (local address 127.25.170.62:38023)
0808 08:30:18.230110 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.230115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.230984 (+ 869us) server_negotiation.cc:407] Connection header received
0808 08:30:18.232446 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.232449 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.232496 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.232565 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.233609 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.234129 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.235216 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.235429 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.235503 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.237823 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.237826 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.237828 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.237851 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.239277 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.239706 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.239708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.239709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.239778 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.240133 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.240135 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.240136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.240299 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.240386 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.240799 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.240892 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260808 08:30:18.241809 687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.230141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.3:57807)
0808 08:30:18.230838 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.230891 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.232256 (+ 1365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.232690 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.232696 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.233032 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.233482 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.233495 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.234235 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.234238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.235108 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.235117 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.235551 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.235553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.235686 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.236221 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.236237 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.237678 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.239379 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.239382 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.239393 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.239624 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.239857 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.239859 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.239860 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.240043 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.240396 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.240401 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.240600 (+ 199us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.240737 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.240972 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":164,"threads_started":1}
I20260808 08:30:18.242934 685 heartbeater.cc:347] Connected to a master server at 127.25.170.62:38023
I20260808 08:30:18.243182 685 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:18.243723 685 heartbeater.cc:511] Master 127.25.170.62:38023 requested a full tablet report, sending...
I20260808 08:30:18.244742 32676 ts_manager.cc:194] Registered new tserver with Master: e93c9b9cccd0455585241fb367c1bf98 (127.25.170.3:44223)
I20260808 08:30:18.245246 32676 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:57807
I20260808 08:30:18.254776 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.25.170.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.61.keytab.
Entry for principal oryx/127.25.170.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.61.keytab.
I20260808 08:30:18.282472 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.61:40449
--webserver_interface=127.25.170.61
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.61.keytab
--principal=oryx/127.25.170.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:38023,127.25.170.61:40449
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:18.394378 690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:18.394644 690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:18.394730 690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:18.398825 690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:18.398895 690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:18.398931 690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:18.398985 690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:18.399022 690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:18.404173 690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:38023,127.25.170.61:40449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.61.keytab
--principal=oryx/127.25.170.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.61:40449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.170.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
W20260808 08:30:18.404408 690 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.25.170.62:38023,127.25.170.61:40449'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 08:30:18.405294 690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:18.406325 690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:18.414980 698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:18.415009 696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:18.415009 695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:18.415128 690 server_base.cc:1034] running on GCE node
I20260808 08:30:18.415719 690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:18.416831 690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:18.417992 690 hybrid_clock.cc:648] HybridClock initialized: now 1786177818417978 us; error 24 us; skew 500 ppm
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:18.420765 690 init.cc:377] Logged in from keytab as oryx/127.25.170.61@KRBTEST.COM (short username oryx)
I20260808 08:30:18.421612 690 webserver.cc:460] Webserver started at http://127.25.170.61:38297/ using document root <none> and password file <none>
I20260808 08:30:18.422163 690 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:18.422256 690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:18.422489 690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:18.424588 690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data/instance:
uuid: "71b95001e64c4879801bdc00ddeebae0"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "f38e694cbb367b44b4183cf08db70aa6"
server_key_iv: "b6b6cb6c463053154f44bacbed99be72"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.425164 690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal/instance:
uuid: "71b95001e64c4879801bdc00ddeebae0"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "f38e694cbb367b44b4183cf08db70aa6"
server_key_iv: "b6b6cb6c463053154f44bacbed99be72"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.428894 690 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:30:18.431209 705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.432510 690 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:18.432651 690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal
uuid: "71b95001e64c4879801bdc00ddeebae0"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "f38e694cbb367b44b4183cf08db70aa6"
server_key_iv: "b6b6cb6c463053154f44bacbed99be72"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.432765 690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:18.460891 690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:18.464322 690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:18.464540 690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:18.471720 690 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.61:40449
I20260808 08:30:18.472060 758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.61:40449 every 8 connection(s)
I20260808 08:30:18.472766 690 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
I20260808 08:30:18.475626 759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:18.479260 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 690
I20260808 08:30:18.479406 759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.61@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.170.61@KRBTEST.COM
I20260808 08:30:18.493621 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.481371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53604 (local address 127.25.170.62:38023)
0808 08:30:18.481539 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.481545 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.481837 (+ 292us) server_negotiation.cc:407] Connection header received
0808 08:30:18.482650 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.482654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.482733 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.482840 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.484004 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.484927 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.486299 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.486662 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.486783 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.489589 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.489597 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.489600 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.489637 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.491229 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.491853 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.491856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.491858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.491991 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.492364 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.492367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.492368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.492642 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.492758 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.493325 (+ 567us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.493449 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:30:18.494459 763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.481310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:53604)
0808 08:30:18.481685 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.481732 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.482452 (+ 720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.482888 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.482913 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.483445 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.483818 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.483839 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.485066 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.485069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.486174 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.486185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.486810 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.486813 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.486960 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.487558 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.487581 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.489436 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.491382 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.491390 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.491400 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.491727 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.492086 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.492090 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.492091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.492272 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.492778 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.492784 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.493091 (+ 307us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.493238 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.493565 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":146,"threads_started":1}
I20260808 08:30:18.494462 762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.480959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40820 (local address 127.25.170.61:40449)
0808 08:30:18.481439 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.481461 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.481505 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:30:18.482442 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.482462 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.482802 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.482983 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.483863 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.485269 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.486402 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.487006 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.487092 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.490337 (+ 3245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.490348 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.490360 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.490386 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.492145 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.492605 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.492611 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.492613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.492701 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.492977 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.492980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.492981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.493189 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.493414 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.493638 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.493808 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":170,"threads_started":1}
I20260808 08:30:18.495838 759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.61@KRBTEST.COM for oryx/127.25.170.61@KRBTEST.COM
I20260808 08:30:18.503507 763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.496284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:40449 (local address 127.0.0.1:40824)
0808 08:30:18.496427 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.496441 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.496514 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.496866 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.496868 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.497017 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.497093 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.497098 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.497852 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.497855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.498348 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.498356 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.499204 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.499207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.499277 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.499654 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.499664 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.500851 (+ 1187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.502416 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.502418 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.502419 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.502596 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.502825 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.502827 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.502828 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.502896 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.503185 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.503187 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.503253 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.503333 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.503415 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 08:30:18.503578 762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.496560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40824 (local address 127.25.170.61:40449)
0808 08:30:18.496677 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.496682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.496696 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:18.496727 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.496729 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.496766 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.496855 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.497200 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.497731 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.498442 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.499106 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.499187 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.500970 (+ 1783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.500973 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.500975 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.500995 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.502328 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.502671 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.502673 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.502674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.502739 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.502967 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.502969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.502970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.503108 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.503179 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.503386 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.503465 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 08:30:18.506290 759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Bootstrap starting.
I20260808 08:30:18.508576 759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:18.509238 759 log.cc:824] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:18.510926 759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: No bootstrap required, opened a new log
I20260808 08:30:18.513835 759 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } }
I20260808 08:30:18.514029 759 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:18.514061 759 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b95001e64c4879801bdc00ddeebae0, State: Initialized, Role: FOLLOWER
I20260808 08:30:18.514411 759 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } }
I20260808 08:30:18.514907 765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } } }
I20260808 08:30:18.515014 765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:30:18.515552 759 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:30:18.521412 776 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:30:18.521503 776 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:30:18.522719 690 master_runner.cc:428] Detected that this master 71b95001e64c4879801bdc00ddeebae0 is joining an existing cluster
I20260808 08:30:18.522785 690 master_runner.cc:432] Initiating AddMaster RPC to add 127.25.170.61:40449
I20260808 08:30:18.532142 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.524902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53614 (local address 127.25.170.62:38023)
0808 08:30:18.525019 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.525024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.525215 (+ 191us) server_negotiation.cc:407] Connection header received
0808 08:30:18.525425 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.525428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.525479 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.525533 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.526142 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.526677 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.527530 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.527760 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.527882 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.529007 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.529010 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.529013 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.529038 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.530478 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.530905 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.530908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.530910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.530993 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.531285 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.531289 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.531290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.531467 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.531577 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.531859 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.532004 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 08:30:18.532361 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.524859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:53614)
0808 08:30:18.525122 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.525139 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.525291 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.525705 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.525708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.525898 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.526013 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.526019 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.526792 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.526797 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.527407 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.527415 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.527919 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.527923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.528021 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.528536 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.528548 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.528869 (+ 321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.530595 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.530599 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.530601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.530803 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.531087 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.531090 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.531092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.531191 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.531569 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.531572 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.531675 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.531784 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.531953 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":99,"threads_started":1}
I20260808 08:30:18.540300 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.525536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:40449 (local address 127.0.0.1:40828)
0808 08:30:18.532717 (+ 7181us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.532733 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.532829 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.533112 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.533115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.533267 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.533396 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.533404 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.534358 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.534361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.535186 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.535198 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.535792 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.535796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.535915 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.536369 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.536383 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.536730 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.538846 (+ 2116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.538851 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.538853 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.539038 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.539323 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.539325 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.539327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.539405 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.539761 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.539763 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.539850 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.539985 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.540121 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7107,"thread_start_us":97,"threads_started":1}
I20260808 08:30:18.540300 762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.525348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40828 (local address 127.25.170.61:40449)
0808 08:30:18.525451 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.525455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.532779 (+ 7324us) server_negotiation.cc:407] Connection header received
0808 08:30:18.532918 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.532921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.532957 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.533002 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.533510 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.534208 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.535315 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.535656 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.535762 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.536907 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.536910 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.536913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.536934 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.538727 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.539141 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.539144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.539146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.539223 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.539491 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.539496 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.539498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.539659 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.539760 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.540031 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.540171 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":45}
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.62@KRBTEST.COM for oryx/127.25.170.61@KRBTEST.COM
I20260808 08:30:18.548142 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.537367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:40449 (local address 127.0.0.1:40840)
0808 08:30:18.538137 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.538186 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.538315 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.538665 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.538670 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.539092 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.539207 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.539214 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.540308 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.540312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.541278 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.541290 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.541888 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.541892 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.542004 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.542620 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.542637 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.544272 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.546156 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.546165 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.546171 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.546403 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.546693 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.546696 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.546698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.546789 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.547471 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.547478 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.547599 (+ 121us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.547747 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.547973 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":83,"threads_started":1}
I20260808 08:30:18.548146 785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.537374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40840 (local address 127.25.170.61:40449)
0808 08:30:18.537626 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.537634 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.538272 (+ 638us) server_negotiation.cc:407] Connection header received
0808 08:30:18.538454 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.538458 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.538517 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.538614 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.539356 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.540181 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.541478 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.541778 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.541859 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.544456 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.544460 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.544462 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.544486 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.546024 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.546508 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.546512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.546514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.546598 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.547101 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.547105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.547107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.547317 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.547413 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.547825 (+ 412us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.547975 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":112,"threads_started":1}
I20260808 08:30:18.549955 32676 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.25.170.61:40449: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "71b95001e64c4879801bdc00ddeebae0"
member_type: NON_VOTER
last_known_addr {
host: "127.25.170.61"
port: 40449
}
attrs {
promote: true
}
}
dest_uuid: "d6a55413268043de8f78d2056192f997"
cas_config_opid_index: -1
I20260808 08:30:18.550611 32676 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } }
I20260808 08:30:18.552369 788 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 71b95001e64c4879801bdc00ddeebae0 (127.25.170.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } }
I20260808 08:30:18.553030 733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:18.554445 733 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Refusing update from remote peer d6a55413268043de8f78d2056192f997: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 08:30:18.554670 788 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.25.170.61:40449
I20260808 08:30:18.555156 690 master.cc:537] Master@127.25.170.61:40449 shutting down...
I20260808 08:30:18.556197 788 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:18.556520 787 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } }
I20260808 08:30:18.556681 787 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: This master's current role is: LEADER
W20260808 08:30:18.558606 32661 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260808 08:30:18.559939 690 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 08:30:18.560074 32661 consensus_peers.cc:487] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 -> Peer 71b95001e64c4879801bdc00ddeebae0 (127.25.170.61:40449): Couldn't send request to peer 71b95001e64c4879801bdc00ddeebae0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 08:30:18.560228 690 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:18.560316 690 tablet_replica.cc:330] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: stopping tablet replica
WARNING: no policy specified for oryx/127.25.170.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.60@KRBTEST.COM" created.
I20260808 08:30:18.564883 690 master.cc:552] Master@127.25.170.61:40449 shutdown complete.
I20260808 08:30:18.564937 690 master_runner.cc:305] Clearing existing system tablet
I20260808 08:30:18.565196 690 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:18.565259 690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:18.566476 690 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 08:30:18.567312 796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.567519 690 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:18.567670 690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 08:30:18.567726 690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal
uuid: "71b95001e64c4879801bdc00ddeebae0"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "f38e694cbb367b44b4183cf08db70aa6"
server_key_iv: "b6b6cb6c463053154f44bacbed99be72"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.569427 690 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:18.571277 690 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 08:30:18.571389 690 log.cc:1196] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 08:30:18.571677 690 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Deleting consensus metadata
I20260808 08:30:18.571863 690 master_runner.cc:315] Copying system tablet from 127.25.170.62:38023
I20260808 08:30:18.573001 690 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: tablet copy: Beginning tablet copy session from remote peer at address 127.25.170.62:38023
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.60.keytab.
Entry for principal oryx/127.25.170.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.60.keytab.
I20260808 08:30:18.581385 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.573577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53630 (local address 127.25.170.62:38023)
0808 08:30:18.573715 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.573720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.573928 (+ 208us) server_negotiation.cc:407] Connection header received
0808 08:30:18.574125 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.574127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.574169 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.574237 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.574743 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.575367 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.576317 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.576588 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.576698 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.577928 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.577931 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.577933 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.577956 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.579408 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.579939 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.579944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.579946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.580029 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.580345 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.580348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.580350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.580580 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.580696 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.581010 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.581197 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:30:18.581383 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.60:37203
--webserver_interface=127.25.170.60
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.60.keytab
--principal=oryx/127.25.170.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:38023,127.25.170.61:40449,127.25.170.60:37203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:30:18.582813 802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.573527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:53630)
0808 08:30:18.573824 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.573839 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.574037 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.574281 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.574284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.574487 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.574608 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.574615 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.575482 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.575487 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.576197 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.576207 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.576714 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.576718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.576811 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.577384 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.577396 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.577741 (+ 345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.579523 (+ 1782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.579526 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.579529 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.579813 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.580126 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.580129 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.580131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.580247 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.580687 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.580690 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.580805 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.582030 (+ 1225us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.582531 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":94,"threads_started":1}
I20260808 08:30:18.583707 32696 tablet_copy_service.cc:140] P d6a55413268043de8f78d2056192f997: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 71b95001e64c4879801bdc00ddeebae0 ({username='oryx', principal='oryx/127.25.170.61@KRBTEST.COM'} at 127.0.0.1:53630)
I20260808 08:30:18.583993 32696 tablet_copy_service.cc:161] P d6a55413268043de8f78d2056192f997: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 71b95001e64c4879801bdc00ddeebae0 at {username='oryx', principal='oryx/127.25.170.61@KRBTEST.COM'} at 127.0.0.1:53630: session id = 71b95001e64c4879801bdc00ddeebae0-00000000000000000000000000000000
I20260808 08:30:18.585757 32696 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 08:30:18.587224 690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 08:30:18.589373 690 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: tablet copy: Starting download of 0 data blocks...
I20260808 08:30:18.589597 690 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: tablet copy: Starting download of 1 WAL segments...
I20260808 08:30:18.591262 690 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 08:30:18.592922 32696 tablet_copy_service.cc:342] P d6a55413268043de8f78d2056192f997: Request end of tablet copy session 71b95001e64c4879801bdc00ddeebae0-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.25.170.61@KRBTEST.COM'} at 127.0.0.1:53630
I20260808 08:30:18.593034 32696 tablet_copy_service.cc:433] P d6a55413268043de8f78d2056192f997: ending tablet copy session 71b95001e64c4879801bdc00ddeebae0-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 71b95001e64c4879801bdc00ddeebae0
I20260808 08:30:18.599960 690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:18.601536 804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:18.601678 805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:18.601843 807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:18.601887 690 server_base.cc:1034] running on GCE node
I20260808 08:30:18.602180 690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:18.602514 690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:18.603699 690 hybrid_clock.cc:648] HybridClock initialized: now 1786177818603682 us; error 34 us; skew 500 ppm
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:18.605198 690 init.cc:377] Logged in from keytab as oryx/127.25.170.61@KRBTEST.COM (short username oryx)
I20260808 08:30:18.605762 690 webserver.cc:460] Webserver started at http://127.25.170.61:40463/ using document root <none> and password file <none>
I20260808 08:30:18.605998 690 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:18.606043 690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:18.607182 690 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 08:30:18.608136 814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.608414 690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 08:30:18.608512 690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal
uuid: "71b95001e64c4879801bdc00ddeebae0"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "f38e694cbb367b44b4183cf08db70aa6"
server_key_iv: "b6b6cb6c463053154f44bacbed99be72"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.608613 690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:18.621323 690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:18.623515 690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:18.628513 690 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.61:40449
I20260808 08:30:18.629066 690 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
I20260808 08:30:18.629477 868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.61:40449 every 8 connection(s)
I20260808 08:30:18.630661 869 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:30:18.631480 869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Bootstrap starting.
I20260808 08:30:18.639495 869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:30:18.639772 869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Bootstrap complete.
I20260808 08:30:18.640256 869 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } }
I20260808 08:30:18.640393 869 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71b95001e64c4879801bdc00ddeebae0, State: Initialized, Role: LEARNER
I20260808 08:30:18.640511 869 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } }
I20260808 08:30:18.640846 872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } }
I20260808 08:30:18.641021 869 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:18.641006 872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:30:18.644389 884 catalog_manager.cc:1259] Loaded cluster ID: d303f198102a4dac8eeb5770051d57da
I20260808 08:30:18.644493 884 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: loading cluster ID for follower catalog manager: success
I20260808 08:30:18.645987 884 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: acquiring CA information for follower catalog manager: success
I20260808 08:30:18.647038 884 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 08:30:18.732867 803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:18.733152 803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:18.733232 803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:18.737277 803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:18.737356 803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:18.737394 803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:18.737449 803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:18.737489 803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:18.743243 803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:38023,127.25.170.61:40449,127.25.170.60:37203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.60.keytab
--principal=oryx/127.25.170.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.60:37203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.170.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:18.744364 803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:18.745391 803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:18.753713 890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:18.753749 892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:18.753825 889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:18.753877 803 server_base.cc:1034] running on GCE node
I20260808 08:30:18.754511 803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:18.755589 803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:18.756773 803 hybrid_clock.cc:648] HybridClock initialized: now 1786177818756755 us; error 29 us; skew 500 ppm
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:18.759521 803 init.cc:377] Logged in from keytab as oryx/127.25.170.60@KRBTEST.COM (short username oryx)
I20260808 08:30:18.760535 803 webserver.cc:460] Webserver started at http://127.25.170.60:33795/ using document root <none> and password file <none>
I20260808 08:30:18.761075 803 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:18.761162 803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:18.761374 803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:18.763293 803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data/instance:
uuid: "a5f3b22709f042c28c6fe45d972797c2"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "666b75c3160b66bfb4ea15b5c02063c2"
server_key_iv: "b6c749eed4af2318002a7128a5abc73a"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.763859 803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal/instance:
uuid: "a5f3b22709f042c28c6fe45d972797c2"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "666b75c3160b66bfb4ea15b5c02063c2"
server_key_iv: "b6c749eed4af2318002a7128a5abc73a"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.767496 803 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:30:18.769809 899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.771044 803 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:30:18.771188 803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal
uuid: "a5f3b22709f042c28c6fe45d972797c2"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "666b75c3160b66bfb4ea15b5c02063c2"
server_key_iv: "b6c749eed4af2318002a7128a5abc73a"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.771292 803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:18.786741 803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:18.789918 803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:18.790105 803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:18.797314 803 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.60:37203
I20260808 08:30:18.797609 951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.60:37203 every 8 connection(s)
I20260808 08:30:18.798373 803 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
I20260808 08:30:18.801064 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 803
I20260808 08:30:18.801077 952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:18.805949 952 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.170.60@KRBTEST.COM
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.60@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:18.816708 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.802470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45044 (local address 127.25.170.60:37203)
0808 08:30:18.802875 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.802888 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.802922 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:30:18.803756 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.803773 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.804147 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.804478 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.805341 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.806611 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.807597 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.808327 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.808489 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.811678 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.811683 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.811692 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.811719 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.813613 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.814042 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.814048 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.814054 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.814202 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.814500 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.814504 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.814505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.814953 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.815170 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.815504 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.815841 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":130,"threads_started":1}
I20260808 08:30:18.818133 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.807987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53642 (local address 127.25.170.62:38023)
0808 08:30:18.808117 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.808123 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.808913 (+ 790us) server_negotiation.cc:407] Connection header received
0808 08:30:18.809062 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.809064 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.809110 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.809198 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.810169 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.810837 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.811940 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.812296 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.812422 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.814702 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.814704 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.814707 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.814730 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.816324 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.816850 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.816854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.816858 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.816952 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.817245 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.817250 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.817252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.817435 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.817545 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.817853 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.817973 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:30:18.818163 955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.807839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:53642)
0808 08:30:18.808781 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.808845 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.808961 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.809247 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.809252 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.809802 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.810014 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.810024 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.810975 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.810978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.811741 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.811751 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.812419 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.812422 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.812506 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.813090 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.813101 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.814574 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.816430 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.816437 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.816442 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.816721 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.817068 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.817071 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.817072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.817149 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.817543 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.817550 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.817659 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.817793 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.817973 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":778,"thread_start_us":169,"threads_started":1}
I20260808 08:30:18.819137 952 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.60@KRBTEST.COM for oryx/127.25.170.61@KRBTEST.COM
I20260808 08:30:18.826974 955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.819548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:40449 (local address 127.0.0.1:40848)
0808 08:30:18.819666 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.819677 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.819736 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.820234 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.820236 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.820395 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.820493 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.820498 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.821403 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.821408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.821934 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.821942 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.822413 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.822417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.822519 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.822886 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.822897 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.824079 (+ 1182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.825624 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.825627 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.825628 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.825816 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.826089 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.826092 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.826094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.826182 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.826526 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.826528 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.826614 (+ 86us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.826712 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.826834 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 08:30:18.826990 956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.819711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40848 (local address 127.25.170.61:40449)
0808 08:30:18.820025 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.820038 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.820049 (+ 11us) server_negotiation.cc:407] Connection header received
0808 08:30:18.820086 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.820089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.820127 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.820220 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.820614 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.821296 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.822060 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.822304 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.822416 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.824209 (+ 1793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.824212 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.824214 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.824238 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.825528 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.825898 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.825901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.825902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.825996 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.826267 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.826276 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.826277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.826440 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.826514 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.826762 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.826860 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":103,"threads_started":1}
I20260808 08:30:18.827608 405 heartbeater.cc:503] Master 127.25.170.62:38023 was elected leader, sending a full tablet report...
I20260808 08:30:18.827783 952 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.60@KRBTEST.COM for oryx/127.25.170.60@KRBTEST.COM
I20260808 08:30:18.835577 955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.828267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37203 (local address 127.0.0.1:45060)
0808 08:30:18.828383 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.828398 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.828469 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.828750 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.828752 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.828930 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.829017 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.829022 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.830112 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.830115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.830586 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.830593 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.831039 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.831042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.831157 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.831533 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.831544 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.832754 (+ 1210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.834397 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.834399 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.834401 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.834570 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.834804 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.834807 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.834809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.834878 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.835178 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.835180 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.835255 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.835337 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.835424 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":20}
I20260808 08:30:18.835599 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.828439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45060 (local address 127.25.170.60:37203)
0808 08:30:18.828556 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.828560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.828574 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:18.828606 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.828609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.828646 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.828729 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.829119 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.829606 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.830699 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.830934 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.831041 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.832883 (+ 1842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.832886 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.832887 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.832908 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.834309 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.834649 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.834652 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.834653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.834722 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.834953 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.834955 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.834956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.835106 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.835176 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.835393 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.835480 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":49}
I20260808 08:30:18.838431 952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: Bootstrap starting.
I20260808 08:30:18.840969 952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:18.841786 952 log.cc:824] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:18.844058 952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: No bootstrap required, opened a new log
I20260808 08:30:18.847014 952 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } }
I20260808 08:30:18.847218 952 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:18.847265 952 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f3b22709f042c28c6fe45d972797c2, State: Initialized, Role: FOLLOWER
I20260808 08:30:18.847641 952 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } }
I20260808 08:30:18.848148 958 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } } }
I20260808 08:30:18.848285 958 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:30:18.848731 958 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:18.848868 958 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } }
I20260808 08:30:18.848915 952 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:18.849865 958 leader_election.cc:288] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6a55413268043de8f78d2056192f997 (127.25.170.62:38023), 71b95001e64c4879801bdc00ddeebae0 (127.25.170.61:40449)
I20260808 08:30:18.850315 841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5f3b22709f042c28c6fe45d972797c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b95001e64c4879801bdc00ddeebae0" is_pre_election: true
I20260808 08:30:18.850513 841 raft_consensus.cc:1799] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 LEARNER]: Handling vote request from an unknown peer a5f3b22709f042c28c6fe45d972797c2
I20260808 08:30:18.850670 841 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate a5f3b22709f042c28c6fe45d972797c2 for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260808 08:30:18.850847 32686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5f3b22709f042c28c6fe45d972797c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6a55413268043de8f78d2056192f997" is_pre_election: true
I20260808 08:30:18.851459 900 leader_election.cc:302] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5f3b22709f042c28c6fe45d972797c2; no voters: 71b95001e64c4879801bdc00ddeebae0, d6a55413268043de8f78d2056192f997
I20260808 08:30:18.851738 958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:18.852998 958 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260808 08:30:18.854429 969 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:30:18.854506 969 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:30:18.857017 803 master_runner.cc:428] Detected that this master a5f3b22709f042c28c6fe45d972797c2 is joining an existing cluster
I20260808 08:30:18.857065 803 master_runner.cc:432] Initiating AddMaster RPC to add 127.25.170.60:37203
I20260808 08:30:18.867662 976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.858969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:40449 (local address 127.0.0.1:40856)
0808 08:30:18.859330 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.859345 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.859433 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.860087 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.860093 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.860332 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.860513 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.860521 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.861608 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.861611 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.862561 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.862571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.863296 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.863300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.863464 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.864101 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.864111 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.864444 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.866316 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.866319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.866320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.866506 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.866793 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.866795 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.866796 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.866869 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.867278 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.867280 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.867353 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.867432 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.867527 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":24,"thread_start_us":106,"threads_started":1}
I20260808 08:30:18.867797 956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.859713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40856 (local address 127.25.170.61:40449)
0808 08:30:18.859842 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.859847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.859860 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:18.859920 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.859923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.859971 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.860053 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.860650 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.861474 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.862695 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.863049 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.863122 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.864583 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.864587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.864589 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.864617 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.866201 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.866601 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.866604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.866606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.866700 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.866956 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.866959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.866961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.867178 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.867279 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.867514 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.867641 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:30:18.870126 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 32740
I20260808 08:30:18.883262 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:38291
--local_ip_for_outbound_sockets=127.25.170.1
--tserver_master_addrs=127.25.170.62:38023
--webserver_port=44397
--webserver_interface=127.25.170.1
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab
--principal=oryx/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.170.62:38023,127.25.170.61:40449
--tserver_master_addrs=127.25.170.62:38023,127.25.170.61:40449,127.25.170.60:37203 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:30:18.885376 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.859852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45062 (local address 127.25.170.60:37203)
0808 08:30:18.860281 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.860285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.860296 (+ 11us) server_negotiation.cc:407] Connection header received
0808 08:30:18.860328 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.860331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.860370 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.860452 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.861035 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.861776 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.863045 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.863429 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.863513 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.881198 (+ 17685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.881202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.881205 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.881226 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.882896 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.883736 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.883739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.883741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.883828 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.884182 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.884185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.884187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.884484 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.884572 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.884928 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.885162 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":162,"server-negotiator.queue_time_us":360}
I20260808 08:30:18.885394 977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.859369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37203 (local address 127.0.0.1:45062)
0808 08:30:18.859609 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.859623 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.859722 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.860508 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.860512 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.860782 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.860911 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.860919 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.861902 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.861905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.862924 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.862935 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.863621 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.863624 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.863753 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.880551 (+ 16798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.880567 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.881039 (+ 472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.883020 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.883026 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.883030 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.883285 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.883955 (+ 670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.883961 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.883966 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.884083 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.884590 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.884596 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.884741 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.884860 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.885075 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":48,"thread_start_us":87,"threads_started":1}
I20260808 08:30:18.888180 975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.858942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:53656)
0808 08:30:18.859253 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.859279 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.859367 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.860559 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.860565 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.860823 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.860941 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.860948 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.861939 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.861942 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.862949 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.862958 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.863630 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.863638 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.863801 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.881040 (+ 17239us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.881060 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.881926 (+ 866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.886461 (+ 4535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.886468 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.886470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.886732 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.887070 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.887075 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.887077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.887167 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.887632 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.887635 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.887728 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.887837 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.888009 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":145,"thread_start_us":110,"threads_started":1}
I20260808 08:30:18.888368 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.859693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53656 (local address 127.25.170.62:38023)
0808 08:30:18.859921 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.859927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.859941 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:18.859977 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.859980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.860047 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.860124 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.861075 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.861812 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.863078 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.863405 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.863478 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.882370 (+ 18892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.882377 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.882383 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.882420 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.886348 (+ 3928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.886854 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.886860 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.886863 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.886960 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.887282 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.887287 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.887291 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.887521 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.887634 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.887992 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.888130 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177817, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.62@KRBTEST.COM for oryx/127.25.170.60@KRBTEST.COM
I20260808 08:30:18.901912 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.892359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37203 (local address 127.0.0.1:45070)
0808 08:30:18.892562 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.892580 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.892679 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.892969 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.892975 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.893181 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.893327 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.893337 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.894472 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.894478 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.895536 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.895551 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.896192 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.896198 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.896349 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.896816 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.896831 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.898479 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.900387 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.900392 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.900395 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.900637 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.900921 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.900924 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.900926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.901014 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.901416 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.901419 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.901513 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.901616 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.901747 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260808 08:30:18.901937 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.892424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45070 (local address 127.25.170.60:37203)
0808 08:30:18.892524 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.892528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.892651 (+ 123us) server_negotiation.cc:407] Connection header received
0808 08:30:18.892793 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.892796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.892848 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.892927 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.893522 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.894348 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.895673 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.896049 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.896148 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.898598 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.898602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.898604 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.898629 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.900276 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.900737 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.900741 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.900743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.900826 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.901108 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.901111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.901113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.901319 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.901417 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.901683 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.901792 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 08:30:18.903246 32676 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.25.170.60:37203: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2"
member_type: NON_VOTER
last_known_addr {
host: "127.25.170.60"
port: 37203
}
attrs {
promote: true
}
}
dest_uuid: "d6a55413268043de8f78d2056192f997"
cas_config_opid_index: 5
I20260808 08:30:18.903975 32676 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } }
I20260808 08:30:18.905216 790 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a5f3b22709f042c28c6fe45d972797c2 (127.25.170.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:18.906419 926 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 FOLLOWER]: Refusing update from remote peer d6a55413268043de8f78d2056192f997: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 08:30:18.906807 790 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.25.170.60:37203
I20260808 08:30:18.906976 790 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:18.906977 789 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:18.907869 789 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:18.912231 926 raft_consensus.cc:858] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } }
I20260808 08:30:18.912317 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.905443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:40449 (local address 127.0.0.1:40870)
0808 08:30:18.907123 (+ 1680us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.907137 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.907215 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.907648 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.907652 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.907668 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:18.907757 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.907762 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.908919 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.908922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.910663 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.910675 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.911883 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.911913 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.911999 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.912056 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.912127 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.912194 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1616}
I20260808 08:30:18.912736 956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.905702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40870 (local address 127.25.170.61:40449)
0808 08:30:18.907039 (+ 1337us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.907043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.907306 (+ 263us) server_negotiation.cc:407] Connection header received
0808 08:30:18.907365 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.907368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.907438 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.907524 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:18.907884 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.908726 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.910812 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.911558 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.911639 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.911787 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.912507 (+ 720us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.912596 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1236}
I20260808 08:30:18.912716 803 master.cc:537] Master@127.25.170.60:37203 shutting down...
I20260808 08:30:18.913151 841 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 LEARNER]: Refusing update from remote peer d6a55413268043de8f78d2056192f997: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
W20260808 08:30:18.913183 926 raft_consensus.cc:1565] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } }
I20260808 08:30:18.913990 787 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 08:30:18.914934 926 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 71b95001e64c4879801bdc00ddeebae0 (127.25.170.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } }
I20260808 08:30:18.915740 841 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a5f3b22709f042c28c6fe45d972797c2 (127.25.170.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:18.917240 958 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6a55413268043de8f78d2056192f997. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } }
I20260808 08:30:18.917367 958 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 08:30:18.917452 958 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } }
I20260808 08:30:18.917507 958 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 08:30:18.917560 958 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } }
I20260808 08:30:18.917611 958 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 08:30:18.918650 985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:18.918839 985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:30:18.919066 872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6a55413268043de8f78d2056192f997. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: NON_VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: true } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:18.919190 872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:30:18.922286 787 raft_consensus.cc:1050] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997: attempting to promote NON_VOTER 71b95001e64c4879801bdc00ddeebae0 to VOTER
I20260808 08:30:18.922749 787 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } }
I20260808 08:30:18.924256 979 mvcc.cc:205] Tried to move back new op lower bound from 7316184340829503488 to 7316184340652183552. Current Snapshot: MvccSnapshot[applied={T|T < 7316184340685266944}]
I20260808 08:30:18.924729 841 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 LEARNER]: Refusing update from remote peer d6a55413268043de8f78d2056192f997: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 08:30:18.925153 790 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260808 08:30:18.925786 32661 consensus_peers.cc:487] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 -> Peer a5f3b22709f042c28c6fe45d972797c2 (127.25.170.60:37203): Couldn't send request to peer a5f3b22709f042c28c6fe45d972797c2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 08:30:18.927477 790 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 71b95001e64c4879801bdc00ddeebae0 (127.25.170.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:18.929009 790 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:18.929111 790 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:18.929246 790 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:18.929332 790 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:18.930147 841 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 71b95001e64c4879801bdc00ddeebae0 (127.25.170.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:18.931263 803 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260808 08:30:18.931574 803 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260808 08:30:18.931537 872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:18.931650 872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:30:18.931663 803 tablet_replica.cc:330] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: stopping tablet replica
I20260808 08:30:18.936786 803 master.cc:552] Master@127.25.170.60:37203 shutdown complete.
I20260808 08:30:18.936857 803 master_runner.cc:305] Clearing existing system tablet
I20260808 08:30:18.937081 803 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:18.937151 803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:18.938220 803 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 08:30:18.939066 990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.939275 803 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:18.939411 803 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 08:30:18.939455 803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal
uuid: "a5f3b22709f042c28c6fe45d972797c2"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "666b75c3160b66bfb4ea15b5c02063c2"
server_key_iv: "b6c749eed4af2318002a7128a5abc73a"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.941027 803 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:18.943208 803 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 08:30:18.943315 803 log.cc:1196] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 08:30:18.943585 803 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: Deleting consensus metadata
I20260808 08:30:18.943773 803 master_runner.cc:315] Copying system tablet from 127.25.170.62:38023
I20260808 08:30:18.944924 803 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: tablet copy: Beginning tablet copy session from remote peer at address 127.25.170.62:38023
I20260808 08:30:18.953088 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.945517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53672 (local address 127.25.170.62:38023)
0808 08:30:18.945649 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:18.945653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:18.945830 (+ 177us) server_negotiation.cc:407] Connection header received
0808 08:30:18.946014 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:18.946017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:18.946072 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:18.946155 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:18.946606 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.947160 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.948004 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.948240 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.948349 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.949534 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:18.949537 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:18.949540 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:18.949565 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:18.951378 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.951807 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.951810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.951812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.951980 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:18.952249 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:18.952253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:18.952254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:18.952442 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:18.952549 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:18.952820 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 08:30:18.952928 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:30:18.953091 997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:18.945449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:53672)
0808 08:30:18.945727 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:18.945749 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:18.945886 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:18.946172 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:18.946175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:18.946392 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:18.946487 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.946493 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.947279 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.947283 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.947863 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:18.947870 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:18.948362 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:18.948366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:18.948461 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:18.948990 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:18.949004 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:18.949394 (+ 390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:18.951485 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.951489 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.951492 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.951702 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.952062 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:18.952066 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:18.952068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:18.952155 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:18.952539 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:18.952542 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:18.952648 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 08:30:18.952756 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 08:30:18.952895 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":83,"threads_started":1}
I20260808 08:30:18.953853 32696 tablet_copy_service.cc:140] P d6a55413268043de8f78d2056192f997: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a5f3b22709f042c28c6fe45d972797c2 ({username='oryx', principal='oryx/127.25.170.60@KRBTEST.COM'} at 127.0.0.1:53672)
I20260808 08:30:18.953969 32696 tablet_copy_service.cc:161] P d6a55413268043de8f78d2056192f997: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a5f3b22709f042c28c6fe45d972797c2 at {username='oryx', principal='oryx/127.25.170.60@KRBTEST.COM'} at 127.0.0.1:53672: session id = a5f3b22709f042c28c6fe45d972797c2-00000000000000000000000000000000
I20260808 08:30:18.954799 32696 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 08:30:18.955868 803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 08:30:18.957909 803 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: tablet copy: Starting download of 0 data blocks...
I20260808 08:30:18.958093 803 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: tablet copy: Starting download of 1 WAL segments...
I20260808 08:30:18.961321 803 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 08:30:18.962805 32696 tablet_copy_service.cc:342] P d6a55413268043de8f78d2056192f997: Request end of tablet copy session a5f3b22709f042c28c6fe45d972797c2-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.25.170.60@KRBTEST.COM'} at 127.0.0.1:53672
I20260808 08:30:18.962917 32696 tablet_copy_service.cc:433] P d6a55413268043de8f78d2056192f997: ending tablet copy session a5f3b22709f042c28c6fe45d972797c2-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a5f3b22709f042c28c6fe45d972797c2
I20260808 08:30:18.969269 803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:18.970863 1001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:18.970918 998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:18.971125 999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:18.971647 803 server_base.cc:1034] running on GCE node
I20260808 08:30:18.971818 803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:18.972152 803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:18.973292 803 hybrid_clock.cc:648] HybridClock initialized: now 1786177818973300 us; error 41 us; skew 500 ppm
Aug 08 08:30:18 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177818, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:18.974750 803 init.cc:377] Logged in from keytab as oryx/127.25.170.60@KRBTEST.COM (short username oryx)
I20260808 08:30:18.975221 803 webserver.cc:460] Webserver started at http://127.25.170.60:41345/ using document root <none> and password file <none>
I20260808 08:30:18.975421 803 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:18.975478 803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:18.976658 803 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 08:30:18.977573 1008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:18.977797 803 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 08:30:18.977896 803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal
uuid: "a5f3b22709f042c28c6fe45d972797c2"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "666b75c3160b66bfb4ea15b5c02063c2"
server_key_iv: "b6c749eed4af2318002a7128a5abc73a"
server_key_version: "encryptionkey@0"
I20260808 08:30:18.977996 803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:18.983400 803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:18.985381 803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:18.990365 803 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.60:37203
I20260808 08:30:18.990906 803 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
I20260808 08:30:18.991400 1061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.60:37203 every 8 connection(s)
I20260808 08:30:18.992853 1062 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:30:18.993685 1062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: Bootstrap starting.
I20260808 08:30:19.000577 1062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:30:19.000864 1062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: Bootstrap complete.
I20260808 08:30:19.001536 1062 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } }
I20260808 08:30:19.001717 1062 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a5f3b22709f042c28c6fe45d972797c2, State: Initialized, Role: LEARNER
I20260808 08:30:19.001837 1062 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } }
I20260808 08:30:19.002161 1065 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:19.002338 1065 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:30:19.002338 1062 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:19.005285 1076 catalog_manager.cc:1259] Loaded cluster ID: d303f198102a4dac8eeb5770051d57da
I20260808 08:30:19.005378 1076 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: loading cluster ID for follower catalog manager: success
I20260808 08:30:19.007217 1076 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: acquiring CA information for follower catalog manager: success
I20260808 08:30:19.008694 1076 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:30:19.037339 546 heartbeater.cc:503] Master 127.25.170.62:38023 was elected leader, sending a full tablet report...
W20260808 08:30:19.047696 978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:19.048062 978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:19.048141 978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:19.054358 978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:19.054433 978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:19.054520 978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:19.061923 978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab
--principal=oryx/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:38291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=44397
--tserver_master_addrs=127.25.170.62:38023,127.25.170.61:40449,127.25.170.60:37203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:19.063234 978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:19.064249 978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:19.073792 1082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:19.073760 1084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:19.073755 1081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:19.074401 978 server_base.cc:1034] running on GCE node
I20260808 08:30:19.074777 978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:19.075374 978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:19.076526 978 hybrid_clock.cc:648] HybridClock initialized: now 1786177819076496 us; error 40 us; skew 500 ppm
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:19.079180 978 init.cc:377] Logged in from keytab as oryx/127.25.170.1@KRBTEST.COM (short username oryx)
I20260808 08:30:19.080123 978 webserver.cc:460] Webserver started at http://127.25.170.1:44397/ using document root <none> and password file <none>
I20260808 08:30:19.080665 978 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:19.080765 978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:19.084450 978 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 08:30:19.086383 1091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:19.087564 978 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:19.087683 978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "af744f21c2864b7d947853af3fe07036"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "a417183b78218aacbe83cd5c2b10b305"
server_key_iv: "2c1c75cb5af74a3654155a4d3eb417a6"
server_key_version: "encryptionkey@0"
I20260808 08:30:19.088279 978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:19.105569 978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:19.108609 978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:19.108805 978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:19.109452 978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:19.110342 978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:19.110390 978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:19.110455 978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:19.110486 978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:19.120839 978 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:38291
I20260808 08:30:19.120878 1206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:38291 every 8 connection(s)
I20260808 08:30:19.121824 978 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:19.123577 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 978
I20260808 08:30:19.123778 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 410
I20260808 08:30:19.134261 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:36317
--local_ip_for_outbound_sockets=127.25.170.2
--tserver_master_addrs=127.25.170.62:38023
--webserver_port=43179
--webserver_interface=127.25.170.2
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab
--principal=oryx/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.170.62:38023,127.25.170.61:40449
--tserver_master_addrs=127.25.170.62:38023,127.25.170.61:40449,127.25.170.60:37203 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.60@KRBTEST.COM
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.61@KRBTEST.COM
I20260808 08:30:19.140954 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.125680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:47573 (local address 127.25.170.62:38023)
0808 08:30:19.128083 (+ 2403us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.128086 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.128777 (+ 691us) server_negotiation.cc:407] Connection header received
0808 08:30:19.128956 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.128959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.129013 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.129084 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.129727 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.130535 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.132221 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.132565 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.132656 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.136440 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.136447 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.136451 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.136485 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.138322 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.139037 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.139041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.139043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.139131 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.139544 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.139550 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.139554 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.139810 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.139963 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.140631 (+ 668us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.140759 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2295}
I20260808 08:30:19.141793 956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.123618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:41951 (local address 127.25.170.61:40449)
0808 08:30:19.123790 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.123794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.125343 (+ 1549us) server_negotiation.cc:407] Connection header received
0808 08:30:19.127385 (+ 2042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.127388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.127439 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.127515 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.129286 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.130161 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.132200 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.132611 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.132711 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.137467 (+ 4756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.137471 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.137474 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.137505 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.139356 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.139815 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.139818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.139820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.140231 (+ 411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.140555 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.140560 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.140561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.140787 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.140895 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.141539 (+ 644us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.141654 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 08:30:19.143179 1211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.124121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:40449 (local address 127.25.170.1:41951)
0808 08:30:19.125177 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.125232 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.127121 (+ 1889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.127727 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.127738 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.128309 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:19.129088 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.129113 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.130390 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.130396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.132058 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.132072 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.132907 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.132914 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.133162 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.134238 (+ 1076us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:19.134255 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:19.137307 (+ 3052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:19.139473 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.139477 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.139480 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.139706 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.140348 (+ 642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.140351 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.140353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.140439 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.140942 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:19.140946 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:19.141048 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.141173 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.142026 (+ 853us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":850,"mutex_wait_us":637,"spinlock_wait_cycles":12160,"thread_start_us":319,"threads_started":1}
I20260808 08:30:19.143462 1212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.128298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.1:47573)
0808 08:30:19.128693 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.128705 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.128835 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.129214 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.129217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.129438 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:19.129582 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.129589 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.130667 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.130670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.132076 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.132088 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.132837 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.132841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.133167 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.134052 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:19.134077 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:19.136180 (+ 2103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:19.138638 (+ 2458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.138642 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.138654 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.138923 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.139228 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.139232 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.139234 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.139383 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.139967 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:19.139974 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:19.140308 (+ 334us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.141325 (+ 1017us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.141584 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":215,"spinlock_wait_cycles":3968,"thread_start_us":148,"threads_started":1}
I20260808 08:30:19.144141 1214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.125387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37203 (local address 127.25.170.1:45701)
0808 08:30:19.128578 (+ 3191us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.128593 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.128726 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.129457 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.129460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.129623 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:19.129741 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.129747 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.131066 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.131069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.132076 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.132088 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.132837 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.132841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.133166 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.134107 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:19.134125 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:19.137086 (+ 2961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:19.141185 (+ 4099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.141191 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.141195 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.141638 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.142137 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.142143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.142146 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.142294 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.142796 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:19.142800 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:19.142887 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.142978 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.143106 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3122,"mutex_wait_us":188,"spinlock_wait_cycles":1280,"thread_start_us":74,"threads_started":1}
I20260808 08:30:19.144724 1213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.128277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:45701 (local address 127.25.170.60:37203)
0808 08:30:19.129095 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.129109 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.129123 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:19.129168 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.129172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.129218 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.129303 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.129874 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.130940 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.132221 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.132589 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.132680 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.137251 (+ 4571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.137256 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.137259 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.137289 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.141047 (+ 3758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.141821 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.141826 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.141829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.142012 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.142424 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.142429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.142431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.142653 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.142749 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.144444 (+ 1695us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.144555 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":75,"threads_started":1}
I20260808 08:30:19.145306 1208 heartbeater.cc:347] Connected to a master server at 127.25.170.62:38023
I20260808 08:30:19.145573 1208 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:19.145733 1207 heartbeater.cc:347] Connected to a master server at 127.25.170.60:37203
I20260808 08:30:19.145776 1209 heartbeater.cc:347] Connected to a master server at 127.25.170.61:40449
I20260808 08:30:19.145812 1207 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:19.145871 1209 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:19.146220 1207 heartbeater.cc:511] Master 127.25.170.60:37203 requested a full tablet report, sending...
I20260808 08:30:19.146220 1208 heartbeater.cc:511] Master 127.25.170.62:38023 requested a full tablet report, sending...
I20260808 08:30:19.146240 1209 heartbeater.cc:511] Master 127.25.170.61:40449 requested a full tablet report, sending...
I20260808 08:30:19.148021 1025 ts_manager.cc:194] Registered new tserver with Master: af744f21c2864b7d947853af3fe07036 (127.25.170.1:38291)
I20260808 08:30:19.148663 831 ts_manager.cc:194] Registered new tserver with Master: af744f21c2864b7d947853af3fe07036 (127.25.170.1:38291)
I20260808 08:30:19.149505 32676 ts_manager.cc:194] Re-registered known tserver with Master: af744f21c2864b7d947853af3fe07036 (127.25.170.1:38291)
I20260808 08:30:19.150095 32676 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:47573
I20260808 08:30:19.247043 685 heartbeater.cc:503] Master 127.25.170.62:38023 was elected leader, sending a full tablet report...
W20260808 08:30:19.256425 1215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:19.256703 1215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:19.256806 1215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:19.264209 1215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:19.264292 1215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:19.264406 1215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:19.274216 1215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab
--principal=oryx/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:36317
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=43179
--tserver_master_addrs=127.25.170.62:38023,127.25.170.61:40449,127.25.170.60:37203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:19.275719 1215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:19.277251 1215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:19.292392 1220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:19.292398 1221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:19.294054 1223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:19.294168 1215 server_base.cc:1034] running on GCE node
I20260808 08:30:19.294732 1215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:19.295519 1215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:19.296738 1215 hybrid_clock.cc:648] HybridClock initialized: now 1786177819296692 us; error 62 us; skew 500 ppm
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:19.299855 1215 init.cc:377] Logged in from keytab as oryx/127.25.170.2@KRBTEST.COM (short username oryx)
I20260808 08:30:19.301011 1215 webserver.cc:460] Webserver started at http://127.25.170.2:43179/ using document root <none> and password file <none>
I20260808 08:30:19.301625 1215 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:19.301733 1215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:19.306176 1215 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:30:19.308537 1230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:19.309983 1215 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:30:19.310104 1215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112"
format_stamp: "Formatted at 2026-08-08 08:30:17 on dist-test-slave-zkpd"
server_key: "3cb869d6bbd16d2b6353ebadc0988377"
server_key_iv: "d6355aa16126e502cf3b238f41e788ec"
server_key_version: "encryptionkey@0"
I20260808 08:30:19.310644 1215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:19.327601 1215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:19.330776 1215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:19.330960 1215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:19.331511 1215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:19.332442 1215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:19.332518 1215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:19.332598 1215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:19.332636 1215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:19.343864 1215 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:36317
I20260808 08:30:19.344139 1347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:36317 every 8 connection(s)
I20260808 08:30:19.344975 1215 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:19.352710 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 1215
I20260808 08:30:19.352905 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 551
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:19.360431 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.346808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:41107 (local address 127.25.170.62:38023)
0808 08:30:19.346944 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.346949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.347894 (+ 945us) server_negotiation.cc:407] Connection header received
0808 08:30:19.349501 (+ 1607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.349505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.349568 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.349667 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.350895 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.351429 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.353017 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.353382 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.353481 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.356100 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.356104 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.356106 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.356132 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.357876 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.358487 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.358491 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.358492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.358582 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.359053 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.359060 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.359064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.359298 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.359378 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.360103 (+ 725us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.360217 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.61@KRBTEST.COM
I20260808 08:30:19.361927 1352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.347183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.2:41107)
0808 08:30:19.347743 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.347795 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.349289 (+ 1494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.349844 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.349850 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.350189 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:19.350756 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.350771 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.351554 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.351557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.352894 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.352904 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.353636 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.353640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.353804 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.354392 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:19.354408 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:19.355925 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:19.358009 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.358015 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.358028 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.358359 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.358682 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.358685 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.358687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.358873 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.359443 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:19.359451 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:19.359776 (+ 325us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.360593 (+ 817us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.360924 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":232,"threads_started":1}
I20260808 08:30:19.363194 1349 heartbeater.cc:347] Connected to a master server at 127.25.170.62:38023
I20260808 08:30:19.363435 1349 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:19.363950 1349 heartbeater.cc:511] Master 127.25.170.62:38023 requested a full tablet report, sending...
I20260808 08:30:19.365406 32676 ts_manager.cc:194] Re-registered known tserver with Master: e89c9dd6dc224ca3ab1d9ffb6a693112 (127.25.170.2:36317)
I20260808 08:30:19.366030 32676 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:41107
I20260808 08:30:19.366374 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:44223
--local_ip_for_outbound_sockets=127.25.170.3
--tserver_master_addrs=127.25.170.62:38023
--webserver_port=36035
--webserver_interface=127.25.170.3
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab
--principal=oryx/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:39481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.170.62:38023,127.25.170.61:40449
--tserver_master_addrs=127.25.170.62:38023,127.25.170.61:40449,127.25.170.60:37203 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:30:19.369949 956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.355611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:36285 (local address 127.25.170.61:40449)
0808 08:30:19.355768 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.355772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.355789 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:30:19.355838 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.355840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.355885 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.355988 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.356620 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.357482 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.358683 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.359029 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.359111 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.361737 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.361741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.361743 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.361769 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.365129 (+ 3360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.368689 (+ 3560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.368692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.368694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.368794 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.369077 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.369080 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.369082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.369281 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.369388 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.369682 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.369795 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:30:19.370502 1354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.352659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:40449 (local address 127.25.170.2:36285)
0808 08:30:19.353149 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.353160 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.353239 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.356115 (+ 2876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.356118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.356338 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:19.356472 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.356482 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.357655 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.357659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.358552 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.358561 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.359285 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.359288 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.359389 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.359860 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:19.359873 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:19.361586 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:19.368382 (+ 6796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.368385 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.368387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.368576 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.368890 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.368894 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.368896 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.368976 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.369391 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:19.369396 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:19.369501 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.370152 (+ 651us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.370306 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":112,"threads_started":1}
I20260808 08:30:19.371238 1350 heartbeater.cc:347] Connected to a master server at 127.25.170.61:40449
I20260808 08:30:19.371359 1350 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:19.371618 1350 heartbeater.cc:511] Master 127.25.170.61:40449 requested a full tablet report, sending...
I20260808 08:30:19.372495 831 ts_manager.cc:194] Registered new tserver with Master: e89c9dd6dc224ca3ab1d9ffb6a693112 (127.25.170.2:36317)
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.60@KRBTEST.COM
I20260808 08:30:19.376724 1353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.348413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37203 (local address 127.25.170.2:57101)
0808 08:30:19.352166 (+ 3753us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.352184 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.352362 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.366381 (+ 14019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.366386 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.366629 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:19.366767 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.366777 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.368153 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.368158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.369379 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.369394 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.370323 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.370326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.370435 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.371153 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:19.371169 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:19.373341 (+ 2172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:19.375140 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.375144 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.375145 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.375337 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.375617 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.375622 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.375624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.375744 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.376204 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:19.376206 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:19.376280 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.376405 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.376555 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3661,"thread_start_us":131,"threads_started":1}
I20260808 08:30:19.376758 1213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.348560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:57101 (local address 127.25.170.60:37203)
0808 08:30:19.348747 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.348751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.352282 (+ 3531us) server_negotiation.cc:407] Connection header received
0808 08:30:19.366034 (+ 13752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.366040 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.366118 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.366185 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.366934 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.367954 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.369517 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.369887 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.369995 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.373473 (+ 3478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.373477 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.373479 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.373508 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.375005 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.375437 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.375440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.375442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.375524 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.375852 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.375855 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.375857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.376082 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.376143 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.376474 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.376601 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:30:19.377627 1348 heartbeater.cc:347] Connected to a master server at 127.25.170.60:37203
I20260808 08:30:19.377735 1348 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:19.377873 1348 heartbeater.cc:511] Master 127.25.170.60:37203 requested a full tablet report, sending...
I20260808 08:30:19.378615 1025 ts_manager.cc:194] Registered new tserver with Master: e89c9dd6dc224ca3ab1d9ffb6a693112 (127.25.170.2:36317)
W20260808 08:30:19.523257 1355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:19.523494 1355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:19.523535 1355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:19.527679 1355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:19.527730 1355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:19.527834 1355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:19.533749 1355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab
--principal=oryx/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:44223
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=36035
--tserver_master_addrs=127.25.170.62:38023,127.25.170.61:40449,127.25.170.60:37203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:19.534910 1355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:19.535567 1359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.531648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37203 (local address 127.0.0.1:45086)
0808 08:30:19.531942 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.531964 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.532079 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.532389 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.532391 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.532407 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:19.532498 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.532502 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.533484 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.533486 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.534385 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.534397 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.535241 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.535243 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.535323 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.535346 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.535400 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.535457 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
I20260808 08:30:19.535619 1213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.531745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45086 (local address 127.25.170.60:37203)
0808 08:30:19.531881 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.531885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.532046 (+ 161us) server_negotiation.cc:407] Connection header received
0808 08:30:19.532179 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.532183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.532247 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.532359 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:19.532589 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.533380 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.534513 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.535124 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.535239 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.535400 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.535439 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.535504 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:30:19.536218 1355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:30:19.536253 1034 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 08:30:19.536679 1360 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6a55413268043de8f78d2056192f997. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:19.536860 1360 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: This master's current role is: LEARNER
W20260808 08:30:19.546147 1363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:19.546152 1365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:19.546169 1362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:19.546638 1355 server_base.cc:1034] running on GCE node
I20260808 08:30:19.547035 1355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:19.547765 1355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:19.548957 1355 hybrid_clock.cc:648] HybridClock initialized: now 1786177819548946 us; error 28 us; skew 500 ppm
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:19.551589 1355 init.cc:377] Logged in from keytab as oryx/127.25.170.3@KRBTEST.COM (short username oryx)
I20260808 08:30:19.552597 1355 webserver.cc:460] Webserver started at http://127.25.170.3:36035/ using document root <none> and password file <none>
I20260808 08:30:19.553145 1355 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:19.553247 1355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:19.556957 1355 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:19.558982 1373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:19.560297 1355 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:19.560390 1355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "e93c9b9cccd0455585241fb367c1bf98"
format_stamp: "Formatted at 2026-08-08 08:30:18 on dist-test-slave-zkpd"
server_key: "ad38d57a685420098b0c5ac523298f78"
server_key_iv: "31669f9b06a51a5d17e6121a244d00ea"
server_key_version: "encryptionkey@0"
I20260808 08:30:19.560876 1355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:19.576000 1355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:19.578852 1355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:19.579005 1355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:19.579588 1355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:19.580462 1355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:19.580508 1355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:19.580547 1355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:19.580569 1355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:19.589748 1355 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:44223
I20260808 08:30:19.589833 1489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:44223 every 8 connection(s)
I20260808 08:30:19.590785 1355 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:19.598424 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 1355
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.60@KRBTEST.COM
Aug 08 08:30:19 dist-test-slave-zkpd krb5kdc[32630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177819, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.61@KRBTEST.COM
I20260808 08:30:19.608704 956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.592595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:41641 (local address 127.25.170.61:40449)
0808 08:30:19.592732 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.592736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.593908 (+ 1172us) server_negotiation.cc:407] Connection header received
0808 08:30:19.594953 (+ 1045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.594956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.595008 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.595064 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.596536 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.597356 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.598756 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.599086 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.599164 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.604489 (+ 5325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.604493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.604496 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.604522 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.606473 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.606968 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.606971 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.606973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.607056 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.607376 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.607380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.607381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.607592 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.607666 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.608373 (+ 707us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.608504 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:30:19.608960 1496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.593036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.3:44747)
0808 08:30:19.593744 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.593805 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.594725 (+ 920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.595270 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.595279 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.595742 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:19.596367 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.596381 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.597227 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.597232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.598608 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.598621 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.599366 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.599370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.599749 (+ 379us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.600945 (+ 1196us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:19.600960 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:19.602679 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:19.605312 (+ 2633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.605320 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.605337 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.605682 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.606034 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.606038 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.606040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.606213 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.606699 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:19.606705 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:19.606998 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.607208 (+ 210us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.607535 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"mutex_wait_us":379,"spinlock_wait_cycles":1792,"thread_start_us":143,"threads_started":1}
I20260808 08:30:19.609603 1495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.593036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:40449 (local address 127.25.170.3:41641)
0808 08:30:19.593755 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.593813 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.594745 (+ 932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.595272 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.595280 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.595751 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:19.596370 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.596385 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.597468 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.597471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.598608 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.598620 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.599367 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.599372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.599694 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.600783 (+ 1089us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:19.600802 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:19.604326 (+ 3524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:19.606609 (+ 2283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.606611 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.606613 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.606855 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.607165 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.607168 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.607170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.607252 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.607752 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:19.607757 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:19.608142 (+ 385us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.608880 (+ 738us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.609019 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"mutex_wait_us":302,"spinlock_wait_cycles":37888,"thread_start_us":348,"threads_started":1}
I20260808 08:30:19.609651 32716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.592605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:44747 (local address 127.25.170.62:38023)
0808 08:30:19.592734 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.592739 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.593909 (+ 1170us) server_negotiation.cc:407] Connection header received
0808 08:30:19.594940 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.594944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.595007 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.595103 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.596525 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.597063 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.598746 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.599089 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.599163 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.602864 (+ 3701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.602871 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.602877 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.602915 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.605165 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.605821 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.605828 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.605830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.605923 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.606322 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.606328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.606333 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.606556 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.606645 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.609369 (+ 2724us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.609502 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:30:19.609791 1213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.594205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:39823 (local address 127.25.170.60:37203)
0808 08:30:19.594337 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.594342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.594490 (+ 148us) server_negotiation.cc:407] Connection header received
0808 08:30:19.594949 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.594953 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.595011 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.595064 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.596536 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.597356 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.598847 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.599171 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.599240 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.604055 (+ 4815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.604062 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.604067 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.604097 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.605775 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.608291 (+ 2516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.608295 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.608296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.608383 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.608719 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.608722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.608724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.608987 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.609077 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.609537 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.609644 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:30:19.610651 1497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.594090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37203 (local address 127.25.170.3:39823)
0808 08:30:19.594378 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.594393 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.594745 (+ 352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.595272 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.595280 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.595751 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:19.596370 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.596385 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.597663 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.597666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.598731 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.598739 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.599424 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.599427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.599699 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.600600 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:19.600624 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:19.603911 (+ 3287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:19.605891 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.605894 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.605896 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.606126 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.608500 (+ 2374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:19.608503 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:19.608505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:19.608588 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:19.609239 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:19.609243 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:19.609347 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.610217 (+ 870us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.610491 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":238,"spinlock_wait_cycles":56448,"thread_start_us":98,"threads_started":1}
I20260808 08:30:19.610791 1493 heartbeater.cc:347] Connected to a master server at 127.25.170.61:40449
I20260808 08:30:19.610818 1491 heartbeater.cc:347] Connected to a master server at 127.25.170.62:38023
I20260808 08:30:19.611019 1493 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:19.611018 1491 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:19.611619 1491 heartbeater.cc:511] Master 127.25.170.62:38023 requested a full tablet report, sending...
I20260808 08:30:19.611624 1493 heartbeater.cc:511] Master 127.25.170.61:40449 requested a full tablet report, sending...
I20260808 08:30:19.612243 1490 heartbeater.cc:347] Connected to a master server at 127.25.170.60:37203
I20260808 08:30:19.612368 1490 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:19.612524 1490 heartbeater.cc:511] Master 127.25.170.60:37203 requested a full tablet report, sending...
I20260808 08:30:19.613077 831 ts_manager.cc:194] Registered new tserver with Master: e93c9b9cccd0455585241fb367c1bf98 (127.25.170.3:44223)
I20260808 08:30:19.613274 1025 ts_manager.cc:194] Registered new tserver with Master: e93c9b9cccd0455585241fb367c1bf98 (127.25.170.3:44223)
I20260808 08:30:19.613776 32676 ts_manager.cc:194] Re-registered known tserver with Master: e93c9b9cccd0455585241fb367c1bf98 (127.25.170.3:44223)
I20260808 08:30:19.614542 32676 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:44747
I20260808 08:30:19.616559 1504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.601163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45092 (local address 127.25.170.60:37203)
0808 08:30:19.602339 (+ 1176us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.602345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.602885 (+ 540us) server_negotiation.cc:407] Connection header received
0808 08:30:19.603063 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.603067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.603152 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.603239 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.604655 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.605513 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.606954 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.607297 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.607392 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.609593 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.609599 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.609603 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.609632 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.614282 (+ 4650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.614783 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.614789 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.614792 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.614889 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.615228 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.615232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.615233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.615479 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.615612 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.616230 (+ 618us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.616378 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1016,"thread_start_us":91,"threads_started":1}
I20260808 08:30:19.617535 1503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.600722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40874 (local address 127.25.170.61:40449)
0808 08:30:19.601660 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.601664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.602898 (+ 1234us) server_negotiation.cc:407] Connection header received
0808 08:30:19.603143 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.603149 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.603212 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.603288 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.606426 (+ 3138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.607161 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.611673 (+ 4512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.612032 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.612111 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.613761 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.613765 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.613767 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.613792 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.615642 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.616183 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.616187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.616189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.616272 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.616581 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.616585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.616586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.616842 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.616953 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.617318 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.617426 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":857,"thread_start_us":96,"threads_started":1}
I20260808 08:30:19.621790 1507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.601996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53686 (local address 127.25.170.62:38023)
0808 08:30:19.608002 (+ 6006us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.608007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.608023 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:30:19.614425 (+ 6402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.614428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.614474 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.615478 (+ 1004us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.615572 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.616463 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.617428 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.617722 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.618162 (+ 440us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.619212 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.619215 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.619217 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.619237 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.620505 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.620862 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.620864 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.620865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.620936 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.621161 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.621162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.621163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.621316 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.621403 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.621565 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.621651 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5874,"thread_start_us":93,"threads_started":1}
I20260808 08:30:19.624344 32676 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53686:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:30:19.627290 32676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:30:19.629681 787 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: NON_VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: true } } }
I20260808 08:30:19.629812 787 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:19.631609 787 raft_consensus.cc:1050] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997: attempting to promote NON_VOTER a5f3b22709f042c28c6fe45d972797c2 to VOTER
I20260808 08:30:19.631999 787 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } }
I20260808 08:30:19.633132 841 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Refusing update from remote peer d6a55413268043de8f78d2056192f997: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 08:30:19.633172 1034 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 LEARNER]: Refusing update from remote peer d6a55413268043de8f78d2056192f997: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 08:30:19.633538 1509 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 08:30:19.633666 787 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 08:30:19.635426 1510 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a5f3b22709f042c28c6fe45d972797c2 (127.25.170.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:19.635876 1034 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a5f3b22709f042c28c6fe45d972797c2 (127.25.170.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:19.637328 1510 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:19.637462 1510 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:19.637471 1360 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:19.637580 1360 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:30:19.637722 1510 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:19.637850 1510 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:19.638568 841 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a5f3b22709f042c28c6fe45d972797c2 (127.25.170.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:19.640187 787 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:19.640297 787 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:19.641115 1518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6a55413268043de8f78d2056192f997" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:19.641326 1518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:30:19.650579 1359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.644170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:44223 (local address 127.0.0.1:42360)
0808 08:30:19.644464 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.644480 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.644573 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.646020 (+ 1447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.646024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.646042 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:19.646135 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.646140 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.647508 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.647511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.648971 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.648985 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.650196 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.650199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.650283 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.650305 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.650371 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.650447 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":118,"thread_start_us":93,"threads_started":1}
I20260808 08:30:19.650627 1521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.645067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42360 (local address 127.25.170.3:44223)
0808 08:30:19.645535 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.645547 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.645570 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:30:19.645648 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.645654 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.645887 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.646049 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:19.646227 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.647400 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.649350 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.650070 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.650196 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.650353 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.650405 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.650493 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":101,"threads_started":1}
I20260808 08:30:19.651607 1522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.645154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:38291 (local address 127.0.0.1:50194)
0808 08:30:19.645399 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.645413 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.645506 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.648029 (+ 2523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.648032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.648050 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:19.648136 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.648144 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.649047 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.649052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.650173 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.650183 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.651250 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.651253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.651338 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.651361 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.651422 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.651483 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"spinlock_wait_cycles":1920,"thread_start_us":107,"threads_started":1}
I20260808 08:30:19.651746 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.645469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50194 (local address 127.25.170.1:38291)
0808 08:30:19.647639 (+ 2170us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.647644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.647662 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:30:19.647717 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.647721 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.647858 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.648036 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:19.648231 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.648933 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.650317 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.651107 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.651228 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.651401 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.651458 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.651568 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2069,"thread_start_us":84,"threads_started":1}
I20260808 08:30:19.652001 1520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.644512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51726 (local address 127.25.170.2:36317)
0808 08:30:19.644870 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.644882 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.644907 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:30:19.644992 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.644997 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.645234 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.645726 (+ 492us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:19.645897 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.647378 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.649261 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.650070 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.650176 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.650349 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.650647 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.650743 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":144,"threads_started":1}
I20260808 08:30:19.652348 1519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.644128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:36317 (local address 127.0.0.1:51726)
0808 08:30:19.644417 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.644433 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.644544 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.645421 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.645424 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.645445 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:19.645555 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.645563 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.647508 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.647511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.649137 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.649148 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.650411 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.650414 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.650497 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.650519 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.652183 (+ 1664us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.652260 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":160}
I20260808 08:30:19.654156 1423 tablet_service.cc:1467] Processing CreateTablet for tablet dd50ca952c8c4e87b1647aa6bc62150a (DEFAULT_TABLE table=test-table [id=55d89ea4a0e5462c996b8d43755d025e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:19.654493 1281 tablet_service.cc:1467] Processing CreateTablet for tablet dd50ca952c8c4e87b1647aa6bc62150a (DEFAULT_TABLE table=test-table [id=55d89ea4a0e5462c996b8d43755d025e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:19.654577 1141 tablet_service.cc:1467] Processing CreateTablet for tablet dd50ca952c8c4e87b1647aa6bc62150a (DEFAULT_TABLE table=test-table [id=55d89ea4a0e5462c996b8d43755d025e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:19.655284 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd50ca952c8c4e87b1647aa6bc62150a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:19.655308 1423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd50ca952c8c4e87b1647aa6bc62150a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:19.655452 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd50ca952c8c4e87b1647aa6bc62150a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:19.662117 1524 tablet_bootstrap.cc:492] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: Bootstrap starting.
I20260808 08:30:19.664674 1526 tablet_bootstrap.cc:492] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: Bootstrap starting.
I20260808 08:30:19.664740 1524 tablet_bootstrap.cc:654] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:19.665668 1524 log.cc:824] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:19.666581 1526 tablet_bootstrap.cc:654] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:19.667200 1525 tablet_bootstrap.cc:492] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: Bootstrap starting.
I20260808 08:30:19.667913 1524 tablet_bootstrap.cc:492] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: No bootstrap required, opened a new log
I20260808 08:30:19.668107 1524 ts_tablet_manager.cc:1397] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:30:19.668828 1526 log.cc:824] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:19.669165 1525 tablet_bootstrap.cc:654] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:19.669858 1525 log.cc:824] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:19.671497 1525 tablet_bootstrap.cc:492] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: No bootstrap required, opened a new log
I20260808 08:30:19.671697 1525 ts_tablet_manager.cc:1397] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 08:30:19.673636 1526 tablet_bootstrap.cc:492] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: No bootstrap required, opened a new log
I20260808 08:30:19.673837 1526 ts_tablet_manager.cc:1397] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260808 08:30:19.673976 1524 raft_consensus.cc:348] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } }
I20260808 08:30:19.674245 1524 raft_consensus.cc:374] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:19.674299 1524 raft_consensus.cc:729] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89c9dd6dc224ca3ab1d9ffb6a693112, State: Initialized, Role: FOLLOWER
I20260808 08:30:19.674747 1524 consensus_queue.cc:260] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } }
I20260808 08:30:19.675683 1525 raft_consensus.cc:348] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } }
I20260808 08:30:19.675938 1525 raft_consensus.cc:374] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:19.675997 1525 raft_consensus.cc:729] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af744f21c2864b7d947853af3fe07036, State: Initialized, Role: FOLLOWER
I20260808 08:30:19.676240 1349 heartbeater.cc:503] Master 127.25.170.62:38023 was elected leader, sending a full tablet report...
I20260808 08:30:19.676472 1525 consensus_queue.cc:260] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } }
I20260808 08:30:19.678282 1526 raft_consensus.cc:348] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } }
I20260808 08:30:19.678539 1526 raft_consensus.cc:374] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:19.678594 1526 raft_consensus.cc:729] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e93c9b9cccd0455585241fb367c1bf98, State: Initialized, Role: FOLLOWER
I20260808 08:30:19.679024 1524 ts_tablet_manager.cc:1428] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: Time spent starting tablet: real 0.011s user 0.004s sys 0.004s
I20260808 08:30:19.679016 1526 consensus_queue.cc:260] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } }
I20260808 08:30:19.679989 1526 ts_tablet_manager.cc:1428] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: Time spent starting tablet: real 0.006s user 0.001s sys 0.006s
I20260808 08:30:19.680519 1525 ts_tablet_manager.cc:1428] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: Time spent starting tablet: real 0.009s user 0.003s sys 0.003s
I20260808 08:30:19.681233 1491 heartbeater.cc:503] Master 127.25.170.62:38023 was elected leader, sending a full tablet report...
I20260808 08:30:19.683193 1208 heartbeater.cc:503] Master 127.25.170.62:38023 was elected leader, sending a full tablet report...
W20260808 08:30:19.841922 1494 tablet.cc:2369] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:30:19.846477 1532 raft_consensus.cc:482] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:19.846668 1532 raft_consensus.cc:504] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } }
I20260808 08:30:19.847841 1532 leader_election.cc:288] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89c9dd6dc224ca3ab1d9ffb6a693112 (127.25.170.2:36317), af744f21c2864b7d947853af3fe07036 (127.25.170.1:38291)
I20260808 08:30:19.851487 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.848267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:40695 (local address 127.25.170.1:38291)
0808 08:30:19.848404 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.848408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.848423 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:30:19.848548 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.848551 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.848602 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.848685 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:19.848963 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.849472 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.850518 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.850912 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.851043 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.851100 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.851284 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.851353 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:30:19.851500 1497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.848116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:38291 (local address 127.25.170.3:40695)
0808 08:30:19.848284 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.848301 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.848417 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.848700 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.848703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.848720 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:19.848853 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.848858 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.849622 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.849625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.850391 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.850400 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.851043 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.851047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.851158 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.851178 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.851266 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.851346 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 08:30:19.851637 1520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.848266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:41491 (local address 127.25.170.2:36317)
0808 08:30:19.848399 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.848404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.848503 (+ 99us) server_negotiation.cc:407] Connection header received
0808 08:30:19.848669 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.848671 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.848713 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.848802 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:19.849083 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.849570 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.850616 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.851053 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.851183 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.851233 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.851443 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.851511 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:30:19.851637 1495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.848116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:36317 (local address 127.25.170.3:41491)
0808 08:30:19.848404 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:19.848419 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:19.848543 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:19.848824 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:19.848827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:19.848845 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:19.848961 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.848966 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.849687 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.849691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.850480 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:19.850489 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.851180 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.851184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:19.851306 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.851325 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 08:30:19.851424 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 08:30:19.851496 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":138}
I20260808 08:30:19.852324 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd50ca952c8c4e87b1647aa6bc62150a" candidate_uuid: "e93c9b9cccd0455585241fb367c1bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" is_pre_election: true
I20260808 08:30:19.852344 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd50ca952c8c4e87b1647aa6bc62150a" candidate_uuid: "e93c9b9cccd0455585241fb367c1bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af744f21c2864b7d947853af3fe07036" is_pre_election: true
I20260808 08:30:19.852630 1302 raft_consensus.cc:2454] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e93c9b9cccd0455585241fb367c1bf98 in term 0.
I20260808 08:30:19.852640 1161 raft_consensus.cc:2454] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e93c9b9cccd0455585241fb367c1bf98 in term 0.
W20260808 08:30:19.852762 1351 tablet.cc:2369] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:30:19.853117 1376 leader_election.cc:302] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: af744f21c2864b7d947853af3fe07036, e89c9dd6dc224ca3ab1d9ffb6a693112, e93c9b9cccd0455585241fb367c1bf98; no voters:
I20260808 08:30:19.853399 1532 raft_consensus.cc:2781] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:30:19.853487 1532 raft_consensus.cc:482] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:30:19.853530 1532 raft_consensus.cc:3037] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:19.854585 1532 raft_consensus.cc:504] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } }
I20260808 08:30:19.854921 1532 leader_election.cc:288] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [CANDIDATE]: Term 1 election: Requested vote from peers e89c9dd6dc224ca3ab1d9ffb6a693112 (127.25.170.2:36317), af744f21c2864b7d947853af3fe07036 (127.25.170.1:38291)
I20260808 08:30:19.855274 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd50ca952c8c4e87b1647aa6bc62150a" candidate_uuid: "e93c9b9cccd0455585241fb367c1bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112"
I20260808 08:30:19.855271 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd50ca952c8c4e87b1647aa6bc62150a" candidate_uuid: "e93c9b9cccd0455585241fb367c1bf98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af744f21c2864b7d947853af3fe07036"
I20260808 08:30:19.855394 1302 raft_consensus.cc:3037] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:19.855394 1161 raft_consensus.cc:3037] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:19.856815 1161 raft_consensus.cc:2454] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e93c9b9cccd0455585241fb367c1bf98 in term 1.
I20260808 08:30:19.856822 1302 raft_consensus.cc:2454] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e93c9b9cccd0455585241fb367c1bf98 in term 1.
I20260808 08:30:19.857132 1375 leader_election.cc:302] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e89c9dd6dc224ca3ab1d9ffb6a693112, e93c9b9cccd0455585241fb367c1bf98; no voters:
I20260808 08:30:19.857340 1532 raft_consensus.cc:2781] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:19.857594 1532 raft_consensus.cc:686] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 1 LEADER]: Becoming Leader. State: Replica: e93c9b9cccd0455585241fb367c1bf98, State: Running, Role: LEADER
I20260808 08:30:19.857944 1532 consensus_queue.cc:237] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } }
I20260808 08:30:19.861637 32675 catalog_manager.cc:5495] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 reported cstate change: term changed from 0 to 1, leader changed from <none> to e93c9b9cccd0455585241fb367c1bf98 (127.25.170.3). New cstate: current_term: 1 leader_uuid: "e93c9b9cccd0455585241fb367c1bf98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } health_report { overall_health: UNKNOWN } } }
W20260808 08:30:19.873561 1210 tablet.cc:2369] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:30:19.892576 1521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.888824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42372 (local address 127.25.170.3:44223)
0808 08:30:19.889070 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.889075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.889090 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:30:19.889258 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.889261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.889327 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.889438 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:19.889691 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.890192 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.891040 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.891256 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.891374 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.891685 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:19.892143 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:19.892272 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.892377 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.892432 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260808 08:30:19.898769 1161 raft_consensus.cc:1261] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036 [term 1 FOLLOWER]: Refusing update from remote peer e93c9b9cccd0455585241fb367c1bf98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:19.898769 1302 raft_consensus.cc:1261] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 1 FOLLOWER]: Refusing update from remote peer e93c9b9cccd0455585241fb367c1bf98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:19.899544 1532 consensus_queue.cc:1035] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:19.899746 1533 consensus_queue.cc:1035] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:19.911031 1538 mvcc.cc:205] Tried to move back new op lower bound from 7316184350297145344 to 7316184350140936192. Current Snapshot: MvccSnapshot[applied={T|T < 7316184350297145344}]
I20260808 08:30:19.914793 1537 mvcc.cc:205] Tried to move back new op lower bound from 7316184350297145344 to 7316184350140936192. Current Snapshot: MvccSnapshot[applied={T|T < 7316184350297145344 or (T in {7316184350297145344})}]
I20260808 08:30:19.916627 32676 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:19.916795 32676 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:19.920655 32676 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d6a55413268043de8f78d2056192f997: Sending DeleteTablet for 3 replicas of tablet dd50ca952c8c4e87b1647aa6bc62150a
I20260808 08:30:19.921479 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet dd50ca952c8c4e87b1647aa6bc62150a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:19 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:51726
I20260808 08:30:19.921594 1423 tablet_service.cc:1514] Processing DeleteTablet for tablet dd50ca952c8c4e87b1647aa6bc62150a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:19 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:42360
I20260808 08:30:19.921900 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet dd50ca952c8c4e87b1647aa6bc62150a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:19 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:50194
I20260808 08:30:19.922037 1546 tablet_replica.cc:330] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: stopping tablet replica
I20260808 08:30:19.922272 1547 tablet_replica.cc:330] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: stopping tablet replica
I20260808 08:30:19.922336 1546 raft_consensus.cc:2229] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:30:19.922645 1547 raft_consensus.cc:2229] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:19.922709 1546 raft_consensus.cc:2258] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:19.923175 1547 raft_consensus.cc:2258] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:19.924220 1546 ts_tablet_manager.cc:1905] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:19.924798 1547 ts_tablet_manager.cc:1905] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:19.926419 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 32643
I20260808 08:30:19.928762 1546 ts_tablet_manager.cc:1918] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:19.928869 1546 log.cc:1196] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/dd50ca952c8c4e87b1647aa6bc62150a
I20260808 08:30:19.929212 1546 ts_tablet_manager.cc:1939] T dd50ca952c8c4e87b1647aa6bc62150a P e93c9b9cccd0455585241fb367c1bf98: Deleting consensus metadata
I20260808 08:30:19.929702 1547 ts_tablet_manager.cc:1918] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:19.929865 1547 log.cc:1196] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/dd50ca952c8c4e87b1647aa6bc62150a
I20260808 08:30:19.930241 1547 ts_tablet_manager.cc:1939] T dd50ca952c8c4e87b1647aa6bc62150a P af744f21c2864b7d947853af3fe07036: Deleting consensus metadata
W20260808 08:30:19.935879 1094 connection.cc:535] server connection from 127.0.0.1:50194 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 08:30:19.936198 1374 connection.cc:535] server connection from 127.0.0.1:42360 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 08:30:19.936738 1545 tablet_replica.cc:330] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: stopping tablet replica
I20260808 08:30:19.937048 1545 raft_consensus.cc:2229] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:19.937363 1545 raft_consensus.cc:2258] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:19.938838 1545 ts_tablet_manager.cc:1905] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:19.941607 1545 ts_tablet_manager.cc:1918] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:19.941699 1545 log.cc:1196] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/dd50ca952c8c4e87b1647aa6bc62150a
I20260808 08:30:19.942057 1545 ts_tablet_manager.cc:1939] T dd50ca952c8c4e87b1647aa6bc62150a P e89c9dd6dc224ca3ab1d9ffb6a693112: Deleting consensus metadata
W20260808 08:30:19.943288 1234 connection.cc:441] server connection from 127.0.0.1:51726 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51726 (request call id 1) could send its response
I20260808 08:30:19.948266 1503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.925377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40884 (local address 127.25.170.61:40449)
0808 08:30:19.925487 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.925491 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.936801 (+ 11310us) server_negotiation.cc:407] Connection header received
0808 08:30:19.937081 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.937087 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.937143 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.937196 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.938843 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.939625 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.941533 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.941951 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.942040 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.944128 (+ 2088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.944133 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.944136 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.944162 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.946255 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.946777 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.946781 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.946783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.946868 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.947163 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.947166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.947168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.947405 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.947529 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.947966 (+ 437us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.948106 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 08:30:19.951337 956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.939286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40886 (local address 127.25.170.61:40449)
0808 08:30:19.939393 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.939397 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.941001 (+ 1604us) server_negotiation.cc:407] Connection header received
0808 08:30:19.941151 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.941154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.941195 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.941242 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.942333 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.943115 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.944942 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.945322 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.945413 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.947067 (+ 1654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.947070 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.947073 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.947100 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.949115 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.949686 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.949690 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.949695 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.949783 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.950438 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.950444 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.950449 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.950640 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.950734 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.951071 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.951170 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 08:30:19.953151 1213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.939925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45108 (local address 127.25.170.60:37203)
0808 08:30:19.940037 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.940042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.943449 (+ 3407us) server_negotiation.cc:407] Connection header received
0808 08:30:19.944078 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.944082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.944133 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.944228 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.945044 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.945799 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.946928 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.947257 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.947337 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.949569 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.949572 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.949575 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.949619 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.951307 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.951801 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.951804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.951806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.951891 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.952209 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.952212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.952214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.952423 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.952521 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.952871 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.952992 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 08:30:19.957453 1504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:19.925659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45098 (local address 127.25.170.60:37203)
0808 08:30:19.925762 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:19.925766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:19.948299 (+ 22533us) server_negotiation.cc:407] Connection header received
0808 08:30:19.949571 (+ 1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:19.949574 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:19.949651 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:19.949706 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:19.950492 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.951176 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.952447 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:19.952732 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:19.952833 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:19.954328 (+ 1495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:19.954332 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:19.954335 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:19.954359 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:19.955802 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.956321 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.956325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.956327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.956409 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:19.956674 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:19.956677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:19.956678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:19.956880 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:19.956995 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:19.957189 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 08:30:19.957309 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 08:30:20.914990 1556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:20.914137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.1:58109)
0808 08:30:20.914525 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:20.914641 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":105,"threads_started":1}
W20260808 08:30:20.915623 1208 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:38023 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
I20260808 08:30:20.916348 1557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:20.915243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.2:52859)
0808 08:30:20.916161 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:20.916252 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":842,"thread_start_us":65,"threads_started":1}
W20260808 08:30:20.916735 1349 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:38023 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
I20260808 08:30:20.917608 1558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:20.917206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.3:48981)
0808 08:30:20.917434 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:20.917509 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":59,"threads_started":1}
W20260808 08:30:20.917944 1491 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:38023 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
I20260808 08:30:21.421314 1559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d6a55413268043de8f78d2056192f997)
I20260808 08:30:21.421557 1559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } }
I20260808 08:30:21.422498 1559 leader_election.cc:288] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d6a55413268043de8f78d2056192f997 (127.25.170.62:38023), a5f3b22709f042c28c6fe45d972797c2 (127.25.170.60:37203)
I20260808 08:30:21.422829 1560 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d6a55413268043de8f78d2056192f997)
I20260808 08:30:21.422977 1560 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } }
I20260808 08:30:21.423097 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.422642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:55564)
0808 08:30:21.422882 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.422990 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":55,"threads_started":1}
W20260808 08:30:21.423285 815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
I20260808 08:30:21.423837 1560 leader_election.cc:288] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d6a55413268043de8f78d2056192f997 (127.25.170.62:38023), 71b95001e64c4879801bdc00ddeebae0 (127.25.170.61:40449)
I20260808 08:30:21.424121 1565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.423575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:55580)
0808 08:30:21.423952 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.424031 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":58,"threads_started":1}
W20260808 08:30:21.424480 1009 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
I20260808 08:30:21.424671 1563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.423914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:55592)
0808 08:30:21.424534 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.424588 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":554}
W20260808 08:30:21.424789 815 leader_election.cc:334] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d6a55413268043de8f78d2056192f997 (127.25.170.62:38023): Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
I20260808 08:30:21.425639 1566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.425406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:55608)
0808 08:30:21.425509 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.425563 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:30:21.425781 1009 leader_election.cc:334] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d6a55413268043de8f78d2056192f997 (127.25.170.62:38023): Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
I20260808 08:30:21.427640 1562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.422861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32954 (local address 127.25.170.60:37203)
0808 08:30:21.423737 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:21.423742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:21.423756 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:21.423799 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:21.423802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:21.423853 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:21.424288 (+ 435us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:21.424419 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.425243 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.426566 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.427155 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.427269 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.427343 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:21.427483 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 08:30:21.427558 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":61,"threads_started":1}
I20260808 08:30:21.427728 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.423039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37203 (local address 127.0.0.1:32954)
0808 08:30:21.423235 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.423251 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:21.423347 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:21.424019 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:21.424022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:21.424048 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:21.424176 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.424183 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.425342 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.425345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.426455 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.426464 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.427276 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.427278 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.427344 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.427364 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 08:30:21.427456 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:30:21.427607 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":67,"thread_start_us":48,"threads_started":1}
I20260808 08:30:21.428191 1034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "71b95001e64c4879801bdc00ddeebae0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a5f3b22709f042c28c6fe45d972797c2" is_pre_election: true
I20260808 08:30:21.428416 1034 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b95001e64c4879801bdc00ddeebae0 in term 1.
I20260808 08:30:21.428692 1565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.424165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:40449 (local address 127.0.0.1:58414)
0808 08:30:21.424254 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.424267 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:21.424373 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:21.425075 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:21.425079 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:21.425098 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:21.425177 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.425182 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.426212 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.426215 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.427319 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.427327 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.428288 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.428291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.428395 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.428413 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 08:30:21.428499 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 08:30:21.428570 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"spinlock_wait_cycles":2176,"thread_start_us":66,"threads_started":1}
I20260808 08:30:21.428690 1567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.424234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58414 (local address 127.25.170.61:40449)
0808 08:30:21.424595 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:21.424603 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:21.424614 (+ 11us) server_negotiation.cc:407] Connection header received
0808 08:30:21.424671 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:21.424674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:21.424721 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:21.425053 (+ 332us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:21.425323 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.426110 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.427426 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.428151 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.428292 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.428344 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:21.428515 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 08:30:21.428581 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":311,"thread_start_us":105,"threads_started":1}
I20260808 08:30:21.428793 817 leader_election.cc:302] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b95001e64c4879801bdc00ddeebae0, a5f3b22709f042c28c6fe45d972797c2; no voters: d6a55413268043de8f78d2056192f997
I20260808 08:30:21.429045 1559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 08:30:21.429127 1559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d6a55413268043de8f78d2056192f997)
I20260808 08:30:21.429183 1559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:30:21.429298 841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5f3b22709f042c28c6fe45d972797c2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "71b95001e64c4879801bdc00ddeebae0" is_pre_election: true
I20260808 08:30:21.430243 1559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } }
I20260808 08:30:21.430480 841 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5f3b22709f042c28c6fe45d972797c2 in current term 2: Already voted for candidate 71b95001e64c4879801bdc00ddeebae0 in this term.
I20260808 08:30:21.430632 1559 leader_election.cc:288] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [CANDIDATE]: Term 2 election: Requested vote from peers d6a55413268043de8f78d2056192f997 (127.25.170.62:38023), a5f3b22709f042c28c6fe45d972797c2 (127.25.170.60:37203)
I20260808 08:30:21.430941 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.430732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:55624)
0808 08:30:21.430826 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.430881 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 08:30:21.430927 1034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "71b95001e64c4879801bdc00ddeebae0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a5f3b22709f042c28c6fe45d972797c2"
I20260808 08:30:21.431037 1034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:30:21.431183 1011 leader_election.cc:302] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5f3b22709f042c28c6fe45d972797c2; no voters: 71b95001e64c4879801bdc00ddeebae0, d6a55413268043de8f78d2056192f997
I20260808 08:30:21.431545 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.431354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:55638)
0808 08:30:21.431453 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.431503 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 08:30:21.431638 815 leader_election.cc:334] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d6a55413268043de8f78d2056192f997 (127.25.170.62:38023): Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
I20260808 08:30:21.432266 1034 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b95001e64c4879801bdc00ddeebae0 in term 2.
I20260808 08:30:21.432381 1560 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:30:21.432570 817 leader_election.cc:302] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b95001e64c4879801bdc00ddeebae0, a5f3b22709f042c28c6fe45d972797c2; no voters: d6a55413268043de8f78d2056192f997
I20260808 08:30:21.432752 1559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:30:21.432934 1559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [term 2 LEADER]: Becoming Leader. State: Replica: 71b95001e64c4879801bdc00ddeebae0, State: Running, Role: LEADER
I20260808 08:30:21.433179 1559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } }
I20260808 08:30:21.434283 1570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71b95001e64c4879801bdc00ddeebae0. Latest consensus state: current_term: 2 leader_uuid: "71b95001e64c4879801bdc00ddeebae0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:21.434417 1570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:21.434707 1572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:21.436936 1572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:21.437368 1572 catalog_manager.cc:1259] Loaded cluster ID: d303f198102a4dac8eeb5770051d57da
I20260808 08:30:21.437414 1572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:21.437944 1572 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:21.438354 1572 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Loaded TSK: 0
I20260808 08:30:21.439062 1572 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:30:21.470466 831 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40886:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:30:21.473649 831 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:30:21.476558 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.476322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:55642)
0808 08:30:21.476438 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.476493 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 08:30:21.476609 1034 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [term 2 FOLLOWER]: Refusing update from remote peer 71b95001e64c4879801bdc00ddeebae0: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 08:30:21.477137 1570 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 08:30:21.477330 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.477112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.0.0.1:55658)
0808 08:30:21.477197 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.477251 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 08:30:21.477437 815 consensus_peers.cc:487] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 -> Peer d6a55413268043de8f78d2056192f997 (127.25.170.62:38023): Couldn't send request to peer d6a55413268043de8f78d2056192f997. Status: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 08:30:21.478528 1560 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71b95001e64c4879801bdc00ddeebae0. Latest consensus state: current_term: 2 leader_uuid: "71b95001e64c4879801bdc00ddeebae0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:21.478638 1560 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:30:21.479737 1559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "71b95001e64c4879801bdc00ddeebae0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:21.479854 1559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:21.480280 1560 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "71b95001e64c4879801bdc00ddeebae0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d6a55413268043de8f78d2056192f997" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38023 } } peers { permanent_uuid: "71b95001e64c4879801bdc00ddeebae0" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 40449 } attrs { promote: false } } peers { permanent_uuid: "a5f3b22709f042c28c6fe45d972797c2" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37203 } attrs { promote: false } } }
I20260808 08:30:21.480418 1560 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5f3b22709f042c28c6fe45d972797c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:30:21.490036 1563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.485601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:38291 (local address 127.0.0.1:59890)
0808 08:30:21.485881 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.485894 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:21.485971 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:21.486625 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:21.486628 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:21.486642 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:21.486733 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.486741 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.487910 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.487917 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.488843 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.488865 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.489680 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.489684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.489775 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.489800 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:30:21.489860 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 08:30:21.489921 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":93}
I20260808 08:30:21.490571 1581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.485927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:36317 (local address 127.0.0.1:35338)
0808 08:30:21.486180 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.486194 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:21.486490 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:21.486852 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:21.486858 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:21.486878 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:21.486986 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.486991 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.487750 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.487755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.489137 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.489145 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.490163 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.490166 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.490279 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.490304 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:30:21.490368 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 08:30:21.490439 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":139,"thread_start_us":103,"threads_started":1}
I20260808 08:30:21.490672 1561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.485336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:44223 (local address 127.0.0.1:51334)
0808 08:30:21.485440 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.485458 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:21.485544 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:21.486230 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:21.486236 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:21.486256 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:21.486375 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.486384 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.487809 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.487812 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.489111 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.489123 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.490308 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.490312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.490399 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.490418 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 08:30:21.490483 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 08:30:21.490540 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":31}
I20260808 08:30:21.490720 1579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.485471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51334 (local address 127.25.170.3:44223)
0808 08:30:21.485957 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:21.485964 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:21.485981 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:30:21.486035 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:21.486037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:21.486093 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:21.486866 (+ 773us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:21.486991 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.487713 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.489242 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.490195 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.490324 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.490387 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:21.490510 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 08:30:21.490577 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":96,"threads_started":1}
I20260808 08:30:21.491039 1582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.486293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35338 (local address 127.25.170.2:36317)
0808 08:30:21.486526 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:21.486531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:21.486544 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:21.486599 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:21.486604 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:21.486653 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:21.486728 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:21.487107 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.487637 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.489272 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.489920 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.490020 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.490081 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:21.490816 (+ 735us) server_negotiation.cc:299] Negotiation successful
0808 08:30:21.490895 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":70,"threads_started":1}
I20260808 08:30:21.491052 1580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.485881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59890 (local address 127.25.170.1:38291)
0808 08:30:21.486401 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:21.486406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:21.486422 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:30:21.486477 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:21.486481 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:21.486530 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:21.486623 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:21.486898 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.487714 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.488996 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.489550 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.490349 (+ 799us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.490412 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:21.490451 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 08:30:21.490546 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":67,"threads_started":1}
I20260808 08:30:21.491369 1423 tablet_service.cc:1467] Processing CreateTablet for tablet 80184cb87f0a45df900300480205499f (DEFAULT_TABLE table=test-table [id=4b3ec8a892e6459d8c6e447ab2fba40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:21.491446 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 80184cb87f0a45df900300480205499f (DEFAULT_TABLE table=test-table [id=4b3ec8a892e6459d8c6e447ab2fba40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:21.491561 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 80184cb87f0a45df900300480205499f (DEFAULT_TABLE table=test-table [id=4b3ec8a892e6459d8c6e447ab2fba40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:21.491670 1423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80184cb87f0a45df900300480205499f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:21.491669 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80184cb87f0a45df900300480205499f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:21.491869 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80184cb87f0a45df900300480205499f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:21.494082 1583 tablet_bootstrap.cc:492] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036: Bootstrap starting.
I20260808 08:30:21.494587 1586 tablet_bootstrap.cc:492] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98: Bootstrap starting.
I20260808 08:30:21.495061 1583 tablet_bootstrap.cc:654] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:21.495424 1586 tablet_bootstrap.cc:654] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:21.496089 1585 tablet_bootstrap.cc:492] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112: Bootstrap starting.
I20260808 08:30:21.496392 1583 tablet_bootstrap.cc:492] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036: No bootstrap required, opened a new log
I20260808 08:30:21.496493 1583 ts_tablet_manager.cc:1397] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:21.496655 1586 tablet_bootstrap.cc:492] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98: No bootstrap required, opened a new log
I20260808 08:30:21.496749 1586 ts_tablet_manager.cc:1397] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 08:30:21.496975 1583 raft_consensus.cc:348] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } }
I20260808 08:30:21.497117 1585 tablet_bootstrap.cc:654] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:21.497125 1583 raft_consensus.cc:374] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:21.497162 1583 raft_consensus.cc:729] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af744f21c2864b7d947853af3fe07036, State: Initialized, Role: FOLLOWER
I20260808 08:30:21.497167 1586 raft_consensus.cc:348] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } }
I20260808 08:30:21.497268 1586 raft_consensus.cc:374] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:21.497296 1586 raft_consensus.cc:729] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e93c9b9cccd0455585241fb367c1bf98, State: Initialized, Role: FOLLOWER
I20260808 08:30:21.497323 1583 consensus_queue.cc:260] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } }
I20260808 08:30:21.497402 1586 consensus_queue.cc:260] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } }
I20260808 08:30:21.497686 1583 ts_tablet_manager.cc:1428] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 08:30:21.497732 1586 ts_tablet_manager.cc:1428] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 08:30:21.498539 1592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.498131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.1:60989)
0808 08:30:21.498384 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.498443 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":125,"threads_started":1}
I20260808 08:30:21.499941 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.499461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.3:49017)
0808 08:30:21.499705 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.499793 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":89,"threads_started":1}
I20260808 08:30:21.500665 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.500411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.3:37375)
0808 08:30:21.500550 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.500605 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 08:30:21.501220 1493 heartbeater.cc:503] Master 127.25.170.61:40449 was elected leader, sending a full tablet report...
I20260808 08:30:21.501394 1585 tablet_bootstrap.cc:492] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112: No bootstrap required, opened a new log
I20260808 08:30:21.501544 1585 ts_tablet_manager.cc:1397] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 08:30:21.501573 1209 heartbeater.cc:503] Master 127.25.170.61:40449 was elected leader, sending a full tablet report...
I20260808 08:30:21.501724 1592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.501365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.1:45451)
0808 08:30:21.501544 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.501597 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260808 08:30:21.502110 1585 raft_consensus.cc:348] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } }
I20260808 08:30:21.502301 1585 raft_consensus.cc:374] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:21.503017 1585 raft_consensus.cc:729] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89c9dd6dc224ca3ab1d9ffb6a693112, State: Initialized, Role: FOLLOWER
I20260808 08:30:21.503173 1585 consensus_queue.cc:260] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } }
I20260808 08:30:21.503645 1585 ts_tablet_manager.cc:1428] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:21.504387 1595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.503937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.2:36845)
0808 08:30:21.504197 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.504258 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":97,"threads_started":1}
I20260808 08:30:21.505069 1595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.504836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.2:53949)
0808 08:30:21.504947 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.505000 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 08:30:21.505466 1350 heartbeater.cc:503] Master 127.25.170.61:40449 was elected leader, sending a full tablet report...
I20260808 08:30:21.749528 1594 raft_consensus.cc:482] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:21.749665 1594 raft_consensus.cc:504] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } }
I20260808 08:30:21.750910 1594 leader_election.cc:288] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e93c9b9cccd0455585241fb367c1bf98 (127.25.170.3:44223), af744f21c2864b7d947853af3fe07036 (127.25.170.1:38291)
I20260808 08:30:21.755859 1579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.751725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:34677 (local address 127.25.170.3:44223)
0808 08:30:21.751924 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:21.751930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:21.751943 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:21.751996 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:21.751998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:21.752054 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:21.752131 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:21.752568 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.753294 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.754561 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.755156 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.755282 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.755341 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:21.755632 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 08:30:21.755731 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:30:21.755863 1595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.751182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:38291 (local address 127.25.170.2:53781)
0808 08:30:21.751427 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.751444 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:21.751609 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:21.752109 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:21.752114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:21.752138 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:21.752277 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.752283 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.753357 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.753360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.754611 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.754623 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.755464 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.755467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.755594 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.755621 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 08:30:21.755696 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 08:30:21.755767 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":123}
I20260808 08:30:21.755873 1596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.751207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:44223 (local address 127.25.170.2:34677)
0808 08:30:21.751578 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.751589 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:21.751666 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:21.752187 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:21.752193 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:21.752237 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:21.752403 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.752415 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.753388 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.753392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.754431 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:21.754441 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.755346 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.755352 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:21.755483 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.755519 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:30:21.755606 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 08:30:21.755701 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":69,"thread_start_us":159,"threads_started":1}
I20260808 08:30:21.755927 1580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.751301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:53781 (local address 127.25.170.1:38291)
0808 08:30:21.751426 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:21.751431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:21.751521 (+ 90us) server_negotiation.cc:407] Connection header received
0808 08:30:21.751751 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:21.751755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:21.751847 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:21.751930 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:21.752400 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.753213 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.754738 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.755348 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.755454 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.755489 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:21.755721 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 08:30:21.755793 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 08:30:21.756320 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80184cb87f0a45df900300480205499f" candidate_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af744f21c2864b7d947853af3fe07036" is_pre_election: true
I20260808 08:30:21.756376 1443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80184cb87f0a45df900300480205499f" candidate_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e93c9b9cccd0455585241fb367c1bf98" is_pre_election: true
I20260808 08:30:21.756488 1161 raft_consensus.cc:2454] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89c9dd6dc224ca3ab1d9ffb6a693112 in term 0.
I20260808 08:30:21.756597 1443 raft_consensus.cc:2454] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89c9dd6dc224ca3ab1d9ffb6a693112 in term 0.
I20260808 08:30:21.756923 1233 leader_election.cc:302] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af744f21c2864b7d947853af3fe07036, e89c9dd6dc224ca3ab1d9ffb6a693112; no voters:
I20260808 08:30:21.757221 1594 raft_consensus.cc:2781] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:30:21.757283 1594 raft_consensus.cc:482] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:30:21.757329 1594 raft_consensus.cc:3037] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:21.758374 1594 raft_consensus.cc:504] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } }
I20260808 08:30:21.758699 1594 leader_election.cc:288] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [CANDIDATE]: Term 1 election: Requested vote from peers e93c9b9cccd0455585241fb367c1bf98 (127.25.170.3:44223), af744f21c2864b7d947853af3fe07036 (127.25.170.1:38291)
I20260808 08:30:21.759052 1443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80184cb87f0a45df900300480205499f" candidate_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e93c9b9cccd0455585241fb367c1bf98"
I20260808 08:30:21.759100 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80184cb87f0a45df900300480205499f" candidate_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af744f21c2864b7d947853af3fe07036"
I20260808 08:30:21.759162 1443 raft_consensus.cc:3037] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:21.759272 1161 raft_consensus.cc:3037] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:21.760262 1443 raft_consensus.cc:2454] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89c9dd6dc224ca3ab1d9ffb6a693112 in term 1.
I20260808 08:30:21.760339 1161 raft_consensus.cc:2454] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89c9dd6dc224ca3ab1d9ffb6a693112 in term 1.
I20260808 08:30:21.760586 1234 leader_election.cc:302] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e89c9dd6dc224ca3ab1d9ffb6a693112, e93c9b9cccd0455585241fb367c1bf98; no voters:
I20260808 08:30:21.760795 1594 raft_consensus.cc:2781] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:21.761004 1594 raft_consensus.cc:686] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 1 LEADER]: Becoming Leader. State: Replica: e89c9dd6dc224ca3ab1d9ffb6a693112, State: Running, Role: LEADER
I20260808 08:30:21.761271 1594 consensus_queue.cc:237] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } }
I20260808 08:30:21.761801 1596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.761548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.2:52207)
0808 08:30:21.761641 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.761691 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 08:30:21.763773 830 catalog_manager.cc:5495] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89c9dd6dc224ca3ab1d9ffb6a693112 (127.25.170.2). New cstate: current_term: 1 leader_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89c9dd6dc224ca3ab1d9ffb6a693112" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 36317 } health_report { overall_health: HEALTHY } } }
I20260808 08:30:21.781862 1582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.778625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35352 (local address 127.25.170.2:36317)
0808 08:30:21.778735 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:21.778738 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:21.778751 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:21.778872 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:21.778874 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:21.778923 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:21.779057 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:21.779247 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.779735 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.780590 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:21.780800 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:21.780882 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:21.781094 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:21.781513 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:21.781597 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:21.781655 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 08:30:21.781699 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 08:30:21.784466 1161 raft_consensus.cc:1261] T 80184cb87f0a45df900300480205499f P af744f21c2864b7d947853af3fe07036 [term 1 FOLLOWER]: Refusing update from remote peer e89c9dd6dc224ca3ab1d9ffb6a693112: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:21.784741 1443 raft_consensus.cc:1261] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98 [term 1 FOLLOWER]: Refusing update from remote peer e89c9dd6dc224ca3ab1d9ffb6a693112: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:21.784977 1594 consensus_queue.cc:1035] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af744f21c2864b7d947853af3fe07036" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 38291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:21.785283 1597 consensus_queue.cc:1035] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e93c9b9cccd0455585241fb367c1bf98" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:21.787161 1592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.786850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.1:59961)
0808 08:30:21.787024 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.787088 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260808 08:30:21.787287 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.786984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.3:39197)
0808 08:30:21.787140 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.787208 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 08:30:21.791021 1596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.790718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.2:56081)
0808 08:30:21.790887 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.790949 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 08:30:21.792116 1592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.791793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.1:55171)
0808 08:30:21.791974 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.792030 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 08:30:21.793320 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.793054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38023 (local address 127.25.170.3:59409)
0808 08:30:21.793200 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.793250 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:38023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 08:30:21.799280 830 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40886:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:21.799440 830 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40886:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:21.803109 830 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 71b95001e64c4879801bdc00ddeebae0: Sending DeleteTablet for 3 replicas of tablet 80184cb87f0a45df900300480205499f
I20260808 08:30:21.803946 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 80184cb87f0a45df900300480205499f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:21 UTC) from {username='oryx', principal='oryx/127.25.170.61@KRBTEST.COM'} at 127.0.0.1:35338
I20260808 08:30:21.804185 1423 tablet_service.cc:1514] Processing DeleteTablet for tablet 80184cb87f0a45df900300480205499f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:21 UTC) from {username='oryx', principal='oryx/127.25.170.61@KRBTEST.COM'} at 127.0.0.1:51334
I20260808 08:30:21.804294 1610 tablet_replica.cc:330] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112: stopping tablet replica
I20260808 08:30:21.804427 1610 raft_consensus.cc:2229] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:30:21.804690 1610 raft_consensus.cc:2258] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:21.804808 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 80184cb87f0a45df900300480205499f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:21 UTC) from {username='oryx', principal='oryx/127.25.170.61@KRBTEST.COM'} at 127.0.0.1:59890
I20260808 08:30:21.805280 1611 tablet_replica.cc:330] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98: stopping tablet replica
I20260808 08:30:21.805410 1611 raft_consensus.cc:2229] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:21.805462 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 978
I20260808 08:30:21.805449 1610 ts_tablet_manager.cc:1905] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:21.805527 1611 raft_consensus.cc:2258] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:21.806881 1611 ts_tablet_manager.cc:1905] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:21.810027 1611 ts_tablet_manager.cc:1918] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:21.810130 1611 log.cc:1196] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/80184cb87f0a45df900300480205499f
I20260808 08:30:21.810453 1611 ts_tablet_manager.cc:1939] T 80184cb87f0a45df900300480205499f P e93c9b9cccd0455585241fb367c1bf98: Deleting consensus metadata
I20260808 08:30:21.810827 1610 ts_tablet_manager.cc:1918] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:21.810920 1610 log.cc:1196] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/80184cb87f0a45df900300480205499f
I20260808 08:30:21.811125 818 catalog_manager.cc:4841] TS e93c9b9cccd0455585241fb367c1bf98 (127.25.170.3:44223): tablet 80184cb87f0a45df900300480205499f (table test-table [id=4b3ec8a892e6459d8c6e447ab2fba40c]) successfully deleted
I20260808 08:30:21.811244 1610 ts_tablet_manager.cc:1939] T 80184cb87f0a45df900300480205499f P e89c9dd6dc224ca3ab1d9ffb6a693112: Deleting consensus metadata
I20260808 08:30:21.811841 816 catalog_manager.cc:4841] TS e89c9dd6dc224ca3ab1d9ffb6a693112 (127.25.170.2:36317): tablet 80184cb87f0a45df900300480205499f (table test-table [id=4b3ec8a892e6459d8c6e447ab2fba40c]) successfully deleted
I20260808 08:30:21.818121 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 1215
I20260808 08:30:21.818192 1581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:21.817915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:38291 (local address 127.0.0.1:59896)
0808 08:30:21.818051 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:21.818111 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:30:21.819149 817 catalog_manager.cc:4584] TS af744f21c2864b7d947853af3fe07036 (127.25.170.1:38291): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 80184cb87f0a45df900300480205499f: Network error: Client connection negotiation failed: client connection to 127.25.170.1:38291: connect: Connection refused (error 111)
I20260808 08:30:21.826112 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 1355
I20260808 08:30:21.834200 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 690
I20260808 08:30:21.840986 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 803
2026-08-08T08:30:21Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5683 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:21 dist-test-slave-zkpd krb5kdc[1615](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:21 dist-test-slave-zkpd krb5kdc[1615](info): set up 2 sockets
Aug 08 08:30:21 dist-test-slave-zkpd krb5kdc[1615](info): commencing operation
krb5kdc: starting...
W20260808 08:30:22.906183 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:22 dist-test-slave-zkpd krb5kdc[1615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:23Z Disabled control of system clock
WARNING: no policy specified for oryx/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.62.keytab.
Entry for principal oryx/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.62.keytab.
I20260808 08:30:23.034123 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:41879
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.62.keytab
--principal=oryx/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:41879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:23.144706 1629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:23.144984 1629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:23.145025 1629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:23.148928 1629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:23.148978 1629 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:30:23.148995 1629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:23.149014 1629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:23.149030 1629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:23.149102 1629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:23.154433 1629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:41879
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.62.keytab
--principal=oryx/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:41879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:23.155536 1629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:23.156626 1629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:23.165052 1634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:23.165059 1637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:23.165586 1635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:23.165660 1629 server_base.cc:1034] running on GCE node
I20260808 08:30:23.166232 1629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:23.167318 1629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:23.168504 1629 hybrid_clock.cc:648] HybridClock initialized: now 1786177823168471 us; error 45 us; skew 500 ppm
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177823, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:23.171237 1629 init.cc:377] Logged in from keytab as oryx/127.25.170.62@KRBTEST.COM (short username oryx)
I20260808 08:30:23.172240 1629 webserver.cc:460] Webserver started at http://127.25.170.62:46069/ using document root <none> and password file <none>
I20260808 08:30:23.172794 1629 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:23.172904 1629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:23.173139 1629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:23.175186 1629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "b39b32b52bb04521af0861cae67296c2"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "3fe8ebd90f09daa31fe7d35b97bc6859"
server_key_iv: "7bb84167ebb171aa5b985ce9de344a2a"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.175743 1629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "b39b32b52bb04521af0861cae67296c2"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "3fe8ebd90f09daa31fe7d35b97bc6859"
server_key_iv: "7bb84167ebb171aa5b985ce9de344a2a"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.179481 1629 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:30:23.181985 1644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:23.183250 1629 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:23.183396 1629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "b39b32b52bb04521af0861cae67296c2"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "3fe8ebd90f09daa31fe7d35b97bc6859"
server_key_iv: "7bb84167ebb171aa5b985ce9de344a2a"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.183509 1629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:23.215169 1629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:23.218430 1629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:23.218662 1629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:23.227062 1629 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:41879
I20260808 08:30:23.227133 1707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:41879 every 8 connection(s)
I20260808 08:30:23.228170 1629 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:23.230397 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 1629
I20260808 08:30:23.230546 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:23.230885 26280 external_mini_cluster.cc:1428] Setting key 15c2c1f32523f08935cdf971bd964273
I20260808 08:30:23.231379 1708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:23.237601 1708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2: Bootstrap starting.
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:23.240243 1708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:23.241093 1708 log.cc:824] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:23.243366 1708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2: No bootstrap required, opened a new log
I20260808 08:30:23.246069 1711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.232422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57756 (local address 127.25.170.62:41879)
0808 08:30:23.232887 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:23.232902 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:23.232939 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:30:23.233594 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:23.233611 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:23.233956 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:23.234298 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:23.235104 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.236176 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.237030 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.237500 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.237673 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.240385 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:23.240393 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:23.240416 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:23.240444 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:23.242908 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.243340 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.243346 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.243351 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.243544 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.243826 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.243829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.243831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.244363 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:23.244555 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:23.244802 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 08:30:23.245103 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":160,"threads_started":1}
I20260808 08:30:23.247378 1708 raft_consensus.cc:348] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b39b32b52bb04521af0861cae67296c2" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41879 } }
I20260808 08:30:23.247596 1708 raft_consensus.cc:374] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:23.247658 1708 raft_consensus.cc:729] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39b32b52bb04521af0861cae67296c2, State: Initialized, Role: FOLLOWER
I20260808 08:30:23.248140 1708 consensus_queue.cc:260] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b39b32b52bb04521af0861cae67296c2" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41879 } }
I20260808 08:30:23.248322 1708 raft_consensus.cc:388] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:23.248394 1708 raft_consensus.cc:482] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:23.248488 1708 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:23.249397 1708 raft_consensus.cc:504] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b39b32b52bb04521af0861cae67296c2" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41879 } }
I20260808 08:30:23.249742 1708 leader_election.cc:302] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b39b32b52bb04521af0861cae67296c2; no voters:
I20260808 08:30:23.250057 1708 leader_election.cc:288] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:23.250185 1713 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:23.250430 1713 raft_consensus.cc:686] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [term 1 LEADER]: Becoming Leader. State: Replica: b39b32b52bb04521af0861cae67296c2, State: Running, Role: LEADER
I20260808 08:30:23.250732 1713 consensus_queue.cc:237] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b39b32b52bb04521af0861cae67296c2" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41879 } }
I20260808 08:30:23.251209 1708 sys_catalog.cc:564] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:23.252408 1716 sys_catalog.cc:455] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b39b32b52bb04521af0861cae67296c2. Latest consensus state: current_term: 1 leader_uuid: "b39b32b52bb04521af0861cae67296c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b39b32b52bb04521af0861cae67296c2" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41879 } } }
I20260808 08:30:23.252542 1716 sys_catalog.cc:458] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:23.252853 1715 sys_catalog.cc:455] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b39b32b52bb04521af0861cae67296c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b39b32b52bb04521af0861cae67296c2" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41879 } } }
I20260808 08:30:23.252959 1715 sys_catalog.cc:458] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2 [sys.catalog]: This master's current role is: LEADER
W20260808 08:30:23.256060 1731 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:30:23.256122 1731 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:30:23.256196 1723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:23.256910 1723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:23.262459 1723 catalog_manager.cc:1347] Generated new cluster ID: 3d11bad2e46d463eb5c8733640096067
I20260808 08:30:23.262524 1723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:23.272840 1723 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:23.274113 1723 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:23.284358 1723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2: Generated new TSK 0
I20260808 08:30:23.285197 1723 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab.
Entry for principal oryx/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab.
I20260808 08:30:23.318549 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41879
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab
--principal=oryx/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:23.431142 1736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:23.431414 1736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:23.431509 1736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:23.435572 1736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:23.435653 1736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:23.435717 1736 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:30:23.435797 1736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:23.441049 1736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab
--principal=oryx/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.170.62:41879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:23.442101 1736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:23.443138 1736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:23.452566 1743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:23.452571 1742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:23.452581 1745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:23.453042 1736 server_base.cc:1034] running on GCE node
I20260808 08:30:23.453423 1736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:23.454062 1736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:23.455245 1736 hybrid_clock.cc:648] HybridClock initialized: now 1786177823455213 us; error 46 us; skew 500 ppm
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177823, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:23.457966 1736 init.cc:377] Logged in from keytab as oryx/127.25.170.1@KRBTEST.COM (short username oryx)
I20260808 08:30:23.459174 1736 webserver.cc:460] Webserver started at http://127.25.170.1:45129/ using document root <none> and password file <none>
I20260808 08:30:23.459937 1736 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:23.460029 1736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:23.460282 1736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:23.463188 1736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "a47e6bd1e8a44abe9fb80374922e24e2"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "2cb5a90127bedd8cc4b5ebec89afc3a5"
server_key_iv: "f9937806a5fde61084c798128afed2e8"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.463869 1736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "a47e6bd1e8a44abe9fb80374922e24e2"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "2cb5a90127bedd8cc4b5ebec89afc3a5"
server_key_iv: "f9937806a5fde61084c798128afed2e8"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.468093 1736 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:30:23.470417 1753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:23.471602 1736 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:23.471736 1736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "a47e6bd1e8a44abe9fb80374922e24e2"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "2cb5a90127bedd8cc4b5ebec89afc3a5"
server_key_iv: "f9937806a5fde61084c798128afed2e8"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.471843 1736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:23.480705 1736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:23.483286 1736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:23.483489 1736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:23.484951 1736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:23.485020 1736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:23.485091 1736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:23.485128 1736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177823, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:23.496433 1736 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:34327
I20260808 08:30:23.496549 1869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:34327 every 8 connection(s)
I20260808 08:30:23.497318 1736 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:23.499375 1711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.485621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:56473 (local address 127.25.170.62:41879)
0808 08:30:23.485758 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:23.485763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:23.486794 (+ 1031us) server_negotiation.cc:407] Connection header received
0808 08:30:23.487958 (+ 1164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:23.487962 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:23.488019 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:23.488078 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:23.489587 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.490222 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.491611 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.491859 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.492014 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.495460 (+ 3446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:23.495464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:23.495467 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:23.495497 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:23.497117 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.497691 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.497695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.497697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.497805 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.498196 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.498200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.498202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.498401 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:23.498505 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:23.499044 (+ 539us) server_negotiation.cc:299] Negotiation successful
0808 08:30:23.499196 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 08:30:23.500161 1762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.486139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41879 (local address 127.25.170.1:56473)
0808 08:30:23.486643 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:23.486683 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:23.487673 (+ 990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:23.488502 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:23.488508 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:23.488911 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:23.489440 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.489453 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.490354 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.490358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.491481 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.491491 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.492055 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.492060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.492235 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.492814 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:23.492840 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:23.495287 (+ 2447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:23.497241 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.497247 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.497260 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.497587 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.497916 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.497919 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.497922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.498082 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.498523 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:23.498529 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:23.498785 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 08:30:23.498982 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 08:30:23.499296 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":149,"threads_started":1}
I20260808 08:30:23.501629 1870 heartbeater.cc:347] Connected to a master server at 127.25.170.62:41879
I20260808 08:30:23.501791 1870 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:23.502264 1870 heartbeater.cc:511] Master 127.25.170.62:41879 requested a full tablet report, sending...
I20260808 08:30:23.503684 1661 ts_manager.cc:194] Registered new tserver with Master: a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327)
I20260808 08:30:23.505100 1661 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:56473
I20260808 08:30:23.505537 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 1736
I20260808 08:30:23.505676 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:23.506038 26280 external_mini_cluster.cc:1428] Setting key 069f832b0d94f7a6ee9fc1c6a385e98f
I20260808 08:30:23.511358 1711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.503697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:59621 (local address 127.25.170.62:41879)
0808 08:30:23.503818 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:23.503822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:23.504013 (+ 191us) server_negotiation.cc:407] Connection header received
0808 08:30:23.504127 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:23.504129 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:23.504166 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:23.504227 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:23.504700 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.505247 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.506419 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.506722 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.506826 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.508080 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:23.508086 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:23.508091 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:23.508122 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:23.509739 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.510200 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.510204 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.510206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.510291 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.510570 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.510574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.510575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.510755 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:23.510869 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:23.511150 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 08:30:23.511246 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:30:23.511547 1878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.503617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41879 (local address 127.25.170.1:59621)
0808 08:30:23.503940 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:23.503955 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:23.504049 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:23.504270 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:23.504273 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:23.504470 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:23.504587 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.504594 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.505380 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.505384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.506287 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.506298 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.506857 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.506861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.506982 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.507556 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:23.507572 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:23.507940 (+ 368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:23.509883 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.509888 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.509890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.510090 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.510384 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.510388 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.510390 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.510476 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.510859 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:23.510862 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:23.510964 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 08:30:23.511079 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:30:23.511239 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":34,"thread_start_us":96,"threads_started":1}
WARNING: no policy specified for oryx/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab.
Entry for principal oryx/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab.
I20260808 08:30:23.533110 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41879
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab
--principal=oryx/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:23.644737 1881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:23.644980 1881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:23.645021 1881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:23.649039 1881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:23.649101 1881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:23.649164 1881 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:30:23.649206 1881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:23.654418 1881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab
--principal=oryx/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.170.62:41879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:23.655292 1881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:23.656261 1881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:23.665616 1887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:23.665625 1886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:23.665628 1889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:23.665876 1881 server_base.cc:1034] running on GCE node
I20260808 08:30:23.666270 1881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:23.666836 1881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:23.667972 1881 hybrid_clock.cc:648] HybridClock initialized: now 1786177823667950 us; error 24 us; skew 500 ppm
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177823, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:23.670539 1881 init.cc:377] Logged in from keytab as oryx/127.25.170.2@KRBTEST.COM (short username oryx)
I20260808 08:30:23.671360 1881 webserver.cc:460] Webserver started at http://127.25.170.2:33965/ using document root <none> and password file <none>
I20260808 08:30:23.671841 1881 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:23.671947 1881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:23.672140 1881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:23.674055 1881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "5f0165b37cfe4613919b6fd7ee102057"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "c761947f0a2eaab0db06b3b9a131ff3a"
server_key_iv: "4c1059f833ba5e590aad2499abd3cf5a"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.674598 1881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "5f0165b37cfe4613919b6fd7ee102057"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "c761947f0a2eaab0db06b3b9a131ff3a"
server_key_iv: "4c1059f833ba5e590aad2499abd3cf5a"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.678174 1881 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 08:30:23.680522 1896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:23.681814 1881 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:23.681911 1881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "5f0165b37cfe4613919b6fd7ee102057"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "c761947f0a2eaab0db06b3b9a131ff3a"
server_key_iv: "4c1059f833ba5e590aad2499abd3cf5a"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.681993 1881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:23.697701 1881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:23.700520 1881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:23.700670 1881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:23.702265 1881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:23.702314 1881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:23.702378 1881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:23.702412 1881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177823, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:23.713560 1881 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:33297
I20260808 08:30:23.714483 1881 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:23.715369 2014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:33297 every 8 connection(s)
I20260808 08:30:23.716605 1711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.702967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:53213 (local address 127.25.170.62:41879)
0808 08:30:23.703111 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:23.703117 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:23.704042 (+ 925us) server_negotiation.cc:407] Connection header received
0808 08:30:23.705051 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:23.705055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:23.705112 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:23.705172 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:23.706506 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.707262 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.708728 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.708966 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.709095 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.712533 (+ 3438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:23.712537 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:23.712540 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:23.712568 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:23.714319 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.714943 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.714947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.714949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.715046 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.715421 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.715425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.715426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.715634 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:23.715742 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:23.716291 (+ 549us) server_negotiation.cc:299] Negotiation successful
0808 08:30:23.716431 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:30:23.717319 1905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.703389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41879 (local address 127.25.170.2:53213)
0808 08:30:23.703858 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:23.703934 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:23.704782 (+ 848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:23.705557 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:23.705564 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:23.705902 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:23.706353 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.706367 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.707400 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.707408 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.708601 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.708612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.709168 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.709173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.709337 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.709942 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:23.709957 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:23.712339 (+ 2382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:23.714442 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.714451 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.714467 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.714815 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.715160 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.715163 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.715165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.715326 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.715741 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:23.715747 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:23.716048 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 08:30:23.716226 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 08:30:23.716532 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":147,"threads_started":1}
I20260808 08:30:23.718454 2015 heartbeater.cc:347] Connected to a master server at 127.25.170.62:41879
I20260808 08:30:23.718590 2015 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:23.719138 2015 heartbeater.cc:511] Master 127.25.170.62:41879 requested a full tablet report, sending...
I20260808 08:30:23.719579 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 1881
I20260808 08:30:23.719727 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:23.720144 26280 external_mini_cluster.cc:1428] Setting key ed4bbe552004809af12c99938b1bd510
I20260808 08:30:23.720338 1662 ts_manager.cc:194] Registered new tserver with Master: 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297)
I20260808 08:30:23.721125 1662 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:53213
I20260808 08:30:23.728229 1711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.720935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:35621 (local address 127.25.170.62:41879)
0808 08:30:23.721030 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:23.721034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:23.721607 (+ 573us) server_negotiation.cc:407] Connection header received
0808 08:30:23.721706 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:23.721709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:23.721748 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:23.721834 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:23.722271 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.722766 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.723618 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.723844 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.723989 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.725028 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:23.725032 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:23.725034 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:23.725058 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:23.726471 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.726984 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.726986 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.726988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.727061 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.727367 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.727369 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.727370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.727564 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:23.727640 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:23.728026 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 08:30:23.728119 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 08:30:23.728439 2021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.720869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41879 (local address 127.25.170.2:35621)
0808 08:30:23.721518 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:23.721532 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:23.721632 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:23.721856 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:23.721859 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:23.722067 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:23.722160 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.722165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.722918 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.722921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.723488 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.723496 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.723994 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.723998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.724095 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.724575 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:23.724586 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:23.724895 (+ 309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:23.726586 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.726592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.726597 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.726881 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.727161 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.727164 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.727166 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.727265 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.727665 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:23.727669 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:23.727792 (+ 123us) client_negotiation.cc:769] Sending connection context
0808 08:30:23.727981 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 08:30:23.728156 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":118,"threads_started":1}
WARNING: no policy specified for oryx/127.25.170.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab.
Entry for principal oryx/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab.
I20260808 08:30:23.748808 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41879
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab
--principal=oryx/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:23.860582 2024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:23.860816 2024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:23.860858 2024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:23.865000 2024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:23.865068 2024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:23.865104 2024 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:30:23.865135 2024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:23.870273 2024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab
--principal=oryx/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.170.62:41879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:23.871119 2024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:23.872114 2024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:30:23.881668 2024 server_base.cc:1034] running on GCE node
W20260808 08:30:23.881639 2030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:23.881609 2029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:23.881592 2032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:23.882402 2024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:23.882946 2024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:23.884135 2024 hybrid_clock.cc:648] HybridClock initialized: now 1786177823884117 us; error 28 us; skew 500 ppm
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177823, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:23.887117 2024 init.cc:377] Logged in from keytab as oryx/127.25.170.3@KRBTEST.COM (short username oryx)
I20260808 08:30:23.888053 2024 webserver.cc:460] Webserver started at http://127.25.170.3:37921/ using document root <none> and password file <none>
I20260808 08:30:23.888599 2024 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:23.888689 2024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:23.888900 2024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:23.890856 2024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "d7d349861c22470c88976a9a94cee87a"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "5f158c6d2f169a3d4e3e4a659b51d9fc"
server_key_iv: "d5d03a68b31379e51bcbb12a75192c7d"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.891402 2024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "d7d349861c22470c88976a9a94cee87a"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "5f158c6d2f169a3d4e3e4a659b51d9fc"
server_key_iv: "d5d03a68b31379e51bcbb12a75192c7d"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.895020 2024 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:30:23.897437 2039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:23.898545 2024 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:23.898676 2024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "d7d349861c22470c88976a9a94cee87a"
format_stamp: "Formatted at 2026-08-08 08:30:23 on dist-test-slave-zkpd"
server_key: "5f158c6d2f169a3d4e3e4a659b51d9fc"
server_key_iv: "d5d03a68b31379e51bcbb12a75192c7d"
server_key_version: "encryptionkey@0"
I20260808 08:30:23.898783 2024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:23.923388 2024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:23.926178 2024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:23.926378 2024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:23.927816 2024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:23.927887 2024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:23.927995 2024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:23.928054 2024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177823, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:23.938959 2024 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:42237
I20260808 08:30:23.939021 2159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:42237 every 8 connection(s)
I20260808 08:30:23.940068 2024 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:23.942063 1711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.928569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:54703 (local address 127.25.170.62:41879)
0808 08:30:23.928706 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:23.928710 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:23.929714 (+ 1004us) server_negotiation.cc:407] Connection header received
0808 08:30:23.930631 (+ 917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:23.930635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:23.930695 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:23.930822 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:23.932070 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.932919 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.934052 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.934470 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.934594 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.938050 (+ 3456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:23.938054 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:23.938056 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:23.938078 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:23.939780 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.940369 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.940375 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.940380 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.940485 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.940916 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.940919 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.940921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.941164 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:23.941280 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:23.941760 (+ 480us) server_negotiation.cc:299] Negotiation successful
0808 08:30:23.941887 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:30:23.942741 2048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.929076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41879 (local address 127.25.170.3:54703)
0808 08:30:23.929567 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:23.929608 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:23.930427 (+ 819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:23.930990 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:23.930999 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:23.931406 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:23.931866 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.931879 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.933039 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.933041 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.933912 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.933921 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.934654 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.934659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.934892 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.935482 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:23.935500 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:23.937850 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:23.939932 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.939939 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.939953 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.940258 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.940605 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.940608 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.940610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.940814 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.941279 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:23.941286 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:23.941521 (+ 235us) client_negotiation.cc:769] Sending connection context
0808 08:30:23.941699 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 08:30:23.942008 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":151,"threads_started":1}
I20260808 08:30:23.943780 2160 heartbeater.cc:347] Connected to a master server at 127.25.170.62:41879
I20260808 08:30:23.943951 2160 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:23.944497 2160 heartbeater.cc:511] Master 127.25.170.62:41879 requested a full tablet report, sending...
I20260808 08:30:23.945079 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 2024
I20260808 08:30:23.945220 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:23.945574 26280 external_mini_cluster.cc:1428] Setting key 753fa647053cb0176414604fb17bf3d6
I20260808 08:30:23.945641 1661 ts_manager.cc:194] Registered new tserver with Master: d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237)
I20260808 08:30:23.946416 1661 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:54703
I20260808 08:30:23.948891 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:30:23.953675 2166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.946099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41879 (local address 127.25.170.3:53391)
0808 08:30:23.946384 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:23.946398 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:23.946496 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:23.946886 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:23.946889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:23.947127 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:23.947283 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.947291 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.948100 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.948104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.948800 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:23.948809 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.949329 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.949332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:23.949428 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.949894 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:23.949907 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:23.950196 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:23.952262 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.952265 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.952266 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.952456 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.952725 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:23.952726 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:23.952727 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:23.952852 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:23.953293 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:23.953295 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:23.953371 (+ 76us) client_negotiation.cc:769] Sending connection context
0808 08:30:23.953452 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 08:30:23.953550 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":4,"thread_start_us":95,"threads_started":1}
I20260808 08:30:23.953881 1711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.946211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:53391 (local address 127.25.170.62:41879)
0808 08:30:23.946324 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:23.946328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:23.946472 (+ 144us) server_negotiation.cc:407] Connection header received
0808 08:30:23.946626 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:23.946628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:23.946693 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:23.946775 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:23.947401 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.947935 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.948922 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.949202 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.949324 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.950334 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:23.950338 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:23.950340 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:23.950363 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:23.952167 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.952553 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.952559 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.952563 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.952646 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.952951 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.952957 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.952961 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.953196 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:23.953308 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:23.953538 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 08:30:23.953662 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177823, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:30:23.975154 1711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:23.969101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57768 (local address 127.25.170.62:41879)
0808 08:30:23.969243 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:23.969246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:23.969257 (+ 11us) server_negotiation.cc:407] Connection header received
0808 08:30:23.969304 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:23.969306 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:23.969342 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:23.969430 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:23.970157 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.970674 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.971561 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.971775 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.971878 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.975044 (+ 3166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57768: BlockingRecv error: recv got EOF from 127.0.0.1:57768 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 08:30:23 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177823, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:23.985508 1711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.976972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57770 (local address 127.25.170.62:41879)
0808 08:30:23.977086 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:23.977090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:23.977239 (+ 149us) server_negotiation.cc:407] Connection header received
0808 08:30:23.977336 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:23.977339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:23.977382 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:23.977488 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:23.978308 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.979016 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.979887 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:23.980146 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:23.980227 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:23.982371 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:23.982374 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:23.982376 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:23.982398 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:23.983853 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.984279 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.984282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.984283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.984357 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:23.984582 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:23.984584 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:23.984585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:23.984745 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:23.984926 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:23.985213 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 08:30:23.985351 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 08:30:23.988534 1661 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:30:23.991518 1661 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:30:24.006145 2183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.999706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:33297 (local address 127.0.0.1:41076)
0808 08:30:24.000723 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.000769 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.000905 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.001966 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.001969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.001982 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:24.002200 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.002207 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.003576 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.003579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.004643 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.004653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.005648 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.005651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.005742 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.005773 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.005851 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.005982 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":970,"mutex_wait_us":134,"thread_start_us":92,"threads_started":1}
I20260808 08:30:24.006150 2187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.000352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41076 (local address 127.25.170.2:33297)
0808 08:30:24.001446 (+ 1094us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.001487 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.001510 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:30:24.001591 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.001596 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.001791 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.002098 (+ 307us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:24.002297 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.003318 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.004776 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.005533 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.005650 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.005849 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.005907 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.006003 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":968,"thread_start_us":133,"threads_started":1}
I20260808 08:30:24.006467 2185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.999780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34770 (local address 127.25.170.1:34327)
0808 08:30:24.000058 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.000075 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.000874 (+ 799us) server_negotiation.cc:407] Connection header received
0808 08:30:24.001088 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.001094 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.001312 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.001450 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:24.001993 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.003193 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.005036 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.005827 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.005941 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.006071 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.006209 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.006342 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":108,"threads_started":1}
I20260808 08:30:24.006917 2186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:23.999616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:34327 (local address 127.0.0.1:34770)
0808 08:30:24.000720 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.000769 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.000938 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.001655 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.001664 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.001693 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:24.001854 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.001862 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.003336 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.003339 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.004900 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.004912 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.005956 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.005959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.006035 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.006058 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.006662 (+ 604us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.006747 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"mutex_wait_us":43,"thread_start_us":67,"threads_started":1}
I20260808 08:30:24.007689 2184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.000374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:42237 (local address 127.0.0.1:39338)
0808 08:30:24.000886 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.000900 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.000987 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.001885 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.001892 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.001914 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:24.002054 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.002062 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.003545 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.003548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.004904 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.004912 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.007251 (+ 2339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.007257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.007390 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.007416 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.007489 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.007565 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"mutex_wait_us":144,"thread_start_us":121,"threads_started":1}
I20260808 08:30:24.007859 2188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.000566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39338 (local address 127.25.170.3:42237)
0808 08:30:24.001215 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.001227 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.001247 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:30:24.001330 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.001334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.001607 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.001906 (+ 299us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:24.002295 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.003423 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.006131 (+ 2708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.006904 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.007003 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.007188 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.007536 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.007621 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":127,"threads_started":1}
I20260808 08:30:24.009723 1947 tablet_service.cc:1467] Processing CreateTablet for tablet 81f5bd4c105d41e3a5d454856799452c (DEFAULT_TABLE table=test-table [id=0349cefd929a434b9ed9f68aacf7b161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.009719 1803 tablet_service.cc:1467] Processing CreateTablet for tablet 81f5bd4c105d41e3a5d454856799452c (DEFAULT_TABLE table=test-table [id=0349cefd929a434b9ed9f68aacf7b161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.010058 2081 tablet_service.cc:1467] Processing CreateTablet for tablet 81f5bd4c105d41e3a5d454856799452c (DEFAULT_TABLE table=test-table [id=0349cefd929a434b9ed9f68aacf7b161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.010830 1803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f5bd4c105d41e3a5d454856799452c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.010828 1947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f5bd4c105d41e3a5d454856799452c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.011086 2081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f5bd4c105d41e3a5d454856799452c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.017647 2189 tablet_bootstrap.cc:492] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: Bootstrap starting.
I20260808 08:30:24.018776 2190 tablet_bootstrap.cc:492] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: Bootstrap starting.
I20260808 08:30:24.019361 2191 tablet_bootstrap.cc:492] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: Bootstrap starting.
I20260808 08:30:24.020140 2189 tablet_bootstrap.cc:654] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.020888 2190 tablet_bootstrap.cc:654] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.020927 2189 log.cc:824] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:24.021399 2191 tablet_bootstrap.cc:654] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.021718 2190 log.cc:824] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:24.022195 2191 log.cc:824] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:24.023280 2189 tablet_bootstrap.cc:492] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: No bootstrap required, opened a new log
I20260808 08:30:24.023485 2189 ts_tablet_manager.cc:1397] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:30:24.023589 2190 tablet_bootstrap.cc:492] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: No bootstrap required, opened a new log
I20260808 08:30:24.023774 2190 ts_tablet_manager.cc:1397] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 08:30:24.024173 2191 tablet_bootstrap.cc:492] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: No bootstrap required, opened a new log
I20260808 08:30:24.024374 2191 ts_tablet_manager.cc:1397] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:30:24.026579 2189 raft_consensus.cc:348] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.026813 2189 raft_consensus.cc:374] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.026867 2189 raft_consensus.cc:729] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d349861c22470c88976a9a94cee87a, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.027299 2189 consensus_queue.cc:260] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.027949 2160 heartbeater.cc:503] Master 127.25.170.62:41879 was elected leader, sending a full tablet report...
I20260808 08:30:24.027989 2190 raft_consensus.cc:348] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.027989 2191 raft_consensus.cc:348] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.028236 2191 raft_consensus.cc:374] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.028236 2190 raft_consensus.cc:374] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.028293 2190 raft_consensus.cc:729] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a47e6bd1e8a44abe9fb80374922e24e2, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.028285 2191 raft_consensus.cc:729] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f0165b37cfe4613919b6fd7ee102057, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.028693 2189 ts_tablet_manager.cc:1428] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 08:30:24.028756 2191 consensus_queue.cc:260] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.028756 2190 consensus_queue.cc:260] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.029345 1870 heartbeater.cc:503] Master 127.25.170.62:41879 was elected leader, sending a full tablet report...
I20260808 08:30:24.029662 2190 ts_tablet_manager.cc:1428] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 08:30:24.030637 2191 ts_tablet_manager.cc:1428] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:30:24.030985 2015 heartbeater.cc:503] Master 127.25.170.62:41879 was elected leader, sending a full tablet report...
W20260808 08:30:24.191128 2161 tablet.cc:2369] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:30:24.215723 2016 tablet.cc:2369] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:30:24.248747 1871 tablet.cc:2369] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:30:24.357553 2195 raft_consensus.cc:482] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:24.357822 2195 raft_consensus.cc:504] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.359035 2195 leader_election.cc:288] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327), 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297)
I20260808 08:30:24.362861 2048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.359370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:33297 (local address 127.25.170.3:49545)
0808 08:30:24.359593 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.359609 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.359723 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.360083 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.360086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.360105 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:24.360243 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.360249 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.360977 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.360980 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.361763 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.361781 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.362420 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.362424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.362534 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.362554 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.362642 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.362717 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":1}
I20260808 08:30:24.362861 2187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.359442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:49545 (local address 127.25.170.2:33297)
0808 08:30:24.359598 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.359603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.359686 (+ 83us) server_negotiation.cc:407] Connection header received
0808 08:30:24.359878 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.359881 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.359984 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.360067 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:24.360355 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.360864 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.361895 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.362298 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.362423 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.362481 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.362660 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.362732 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:30:24.363629 1966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f5bd4c105d41e3a5d454856799452c" candidate_uuid: "d7d349861c22470c88976a9a94cee87a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f0165b37cfe4613919b6fd7ee102057" is_pre_election: true
I20260808 08:30:24.363708 2185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.359535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:34183 (local address 127.25.170.1:34327)
0808 08:30:24.359659 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.359663 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.359919 (+ 256us) server_negotiation.cc:407] Connection header received
0808 08:30:24.360125 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.360130 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.360179 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.360266 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:24.360864 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.361367 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.362368 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.362836 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.362957 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.363006 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.363523 (+ 517us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.363599 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:30:24.363703 2198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.359370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:34327 (local address 127.25.170.3:34183)
0808 08:30:24.359809 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.359823 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.360010 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.360280 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.360283 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.360298 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:24.360736 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.360742 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.361483 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.361487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.362234 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.362243 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.363287 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.363294 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.363394 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.363413 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.363503 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.363566 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":32,"thread_start_us":130,"threads_started":1}
I20260808 08:30:24.363998 1966 raft_consensus.cc:2454] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7d349861c22470c88976a9a94cee87a in term 0.
I20260808 08:30:24.364388 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f5bd4c105d41e3a5d454856799452c" candidate_uuid: "d7d349861c22470c88976a9a94cee87a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" is_pre_election: true
I20260808 08:30:24.364495 2042 leader_election.cc:302] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f0165b37cfe4613919b6fd7ee102057, d7d349861c22470c88976a9a94cee87a; no voters:
I20260808 08:30:24.364620 1823 raft_consensus.cc:2454] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7d349861c22470c88976a9a94cee87a in term 0.
I20260808 08:30:24.364763 2195 raft_consensus.cc:2781] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:30:24.364876 2195 raft_consensus.cc:482] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:30:24.364943 2195 raft_consensus.cc:3037] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.366042 2195 raft_consensus.cc:504] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.366426 2195 leader_election.cc:288] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [CANDIDATE]: Term 1 election: Requested vote from peers a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327), 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297)
I20260808 08:30:24.366743 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f5bd4c105d41e3a5d454856799452c" candidate_uuid: "d7d349861c22470c88976a9a94cee87a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47e6bd1e8a44abe9fb80374922e24e2"
I20260808 08:30:24.366819 1966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f5bd4c105d41e3a5d454856799452c" candidate_uuid: "d7d349861c22470c88976a9a94cee87a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f0165b37cfe4613919b6fd7ee102057"
I20260808 08:30:24.366891 1823 raft_consensus.cc:3037] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.366989 1966 raft_consensus.cc:3037] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.368045 1823 raft_consensus.cc:2454] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7d349861c22470c88976a9a94cee87a in term 1.
I20260808 08:30:24.368132 1966 raft_consensus.cc:2454] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7d349861c22470c88976a9a94cee87a in term 1.
I20260808 08:30:24.368348 2043 leader_election.cc:302] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a47e6bd1e8a44abe9fb80374922e24e2, d7d349861c22470c88976a9a94cee87a; no voters:
I20260808 08:30:24.368602 2195 raft_consensus.cc:2781] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:24.368783 2195 raft_consensus.cc:686] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 1 LEADER]: Becoming Leader. State: Replica: d7d349861c22470c88976a9a94cee87a, State: Running, Role: LEADER
I20260808 08:30:24.369102 2195 consensus_queue.cc:237] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.372398 1660 catalog_manager.cc:5495] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a reported cstate change: term changed from 0 to 1, leader changed from <none> to d7d349861c22470c88976a9a94cee87a (127.25.170.3). New cstate: current_term: 1 leader_uuid: "d7d349861c22470c88976a9a94cee87a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } health_report { overall_health: HEALTHY } } }
I20260808 08:30:24.460734 2188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.457166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39352 (local address 127.25.170.3:42237)
0808 08:30:24.457299 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.457302 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.457315 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:24.457391 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.457393 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.457449 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.457537 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:24.457768 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.458345 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.459247 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.459468 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.459559 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.459851 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:24.460401 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:24.460490 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.460570 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.460623 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:30:24.466382 1966 raft_consensus.cc:1261] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Refusing update from remote peer d7d349861c22470c88976a9a94cee87a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:24.466516 1823 raft_consensus.cc:1261] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Refusing update from remote peer d7d349861c22470c88976a9a94cee87a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:24.467136 2199 consensus_queue.cc:1035] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:24.467355 2195 consensus_queue.cc:1035] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:24.475378 2202 mvcc.cc:205] Tried to move back new op lower bound from 7316184369007427584 to 7316184368618364928. Current Snapshot: MvccSnapshot[applied={T|T < 7316184369007427584}]
I20260808 08:30:24.476035 2203 mvcc.cc:205] Tried to move back new op lower bound from 7316184369007427584 to 7316184368618364928. Current Snapshot: MvccSnapshot[applied={T|T < 7316184369007427584}]
I20260808 08:30:24.484180 1661 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:24.484355 1661 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:24.486817 1661 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2: Sending DeleteTablet for 3 replicas of tablet 81f5bd4c105d41e3a5d454856799452c
I20260808 08:30:24.487648 1947 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f5bd4c105d41e3a5d454856799452c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:24 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:41076
I20260808 08:30:24.487811 2081 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f5bd4c105d41e3a5d454856799452c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:24 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:39338
I20260808 08:30:24.487809 1803 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f5bd4c105d41e3a5d454856799452c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:24 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:34770
I20260808 08:30:24.488139 2212 tablet_replica.cc:330] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: stopping tablet replica
I20260808 08:30:24.488401 2214 tablet_replica.cc:330] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: stopping tablet replica
I20260808 08:30:24.488443 2212 raft_consensus.cc:2229] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:24.488663 2214 raft_consensus.cc:2229] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:24.488726 2212 raft_consensus.cc:2258] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:24.488952 2214 raft_consensus.cc:2258] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:24.489032 1661 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:30:24.489431 1661 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:30:24.490088 2212 ts_tablet_manager.cc:1905] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:24.490427 2213 tablet_replica.cc:330] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: stopping tablet replica
I20260808 08:30:24.490752 2213 raft_consensus.cc:2229] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:30:24.491178 2213 raft_consensus.cc:2258] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:24.492957 2212 ts_tablet_manager.cc:1918] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:24.493060 2212 log.cc:1196] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/81f5bd4c105d41e3a5d454856799452c
I20260808 08:30:24.493180 2213 ts_tablet_manager.cc:1905] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:24.493409 2212 ts_tablet_manager.cc:1939] T 81f5bd4c105d41e3a5d454856799452c P 5f0165b37cfe4613919b6fd7ee102057: Deleting consensus metadata
I20260808 08:30:24.494606 1648 catalog_manager.cc:4841] TS 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297): tablet 81f5bd4c105d41e3a5d454856799452c (table test-table [id=0349cefd929a434b9ed9f68aacf7b161]) successfully deleted
I20260808 08:30:24.495630 1947 tablet_service.cc:1467] Processing CreateTablet for tablet 43925a32e8db45a1b010c442e5ab6a0a (DEFAULT_TABLE table=test-table [id=d6ebd7b84b52424a9cef22b6f9d8d27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.495879 1947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43925a32e8db45a1b010c442e5ab6a0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.496053 1803 tablet_service.cc:1467] Processing CreateTablet for tablet 43925a32e8db45a1b010c442e5ab6a0a (DEFAULT_TABLE table=test-table [id=d6ebd7b84b52424a9cef22b6f9d8d27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.496337 1803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43925a32e8db45a1b010c442e5ab6a0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.496670 2213 ts_tablet_manager.cc:1918] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:24.496829 2213 log.cc:1196] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/81f5bd4c105d41e3a5d454856799452c
I20260808 08:30:24.497179 2213 ts_tablet_manager.cc:1939] T 81f5bd4c105d41e3a5d454856799452c P d7d349861c22470c88976a9a94cee87a: Deleting consensus metadata
I20260808 08:30:24.498337 1649 catalog_manager.cc:4841] TS d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237): tablet 81f5bd4c105d41e3a5d454856799452c (table test-table [id=0349cefd929a434b9ed9f68aacf7b161]) successfully deleted
I20260808 08:30:24.498944 2190 tablet_bootstrap.cc:492] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2: Bootstrap starting.
I20260808 08:30:24.499219 2081 tablet_service.cc:1467] Processing CreateTablet for tablet 43925a32e8db45a1b010c442e5ab6a0a (DEFAULT_TABLE table=test-table [id=d6ebd7b84b52424a9cef22b6f9d8d27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.499464 2081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43925a32e8db45a1b010c442e5ab6a0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.499958 2190 tablet_bootstrap.cc:654] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.500044 2191 tablet_bootstrap.cc:492] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057: Bootstrap starting.
I20260808 08:30:24.500934 2191 tablet_bootstrap.cc:654] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.501214 2190 tablet_bootstrap.cc:492] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2: No bootstrap required, opened a new log
I20260808 08:30:24.501286 2190 ts_tablet_manager.cc:1397] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 08:30:24.501817 2189 tablet_bootstrap.cc:492] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a: Bootstrap starting.
I20260808 08:30:24.501818 2190 raft_consensus.cc:348] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.501922 2190 raft_consensus.cc:374] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.501955 2190 raft_consensus.cc:729] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a47e6bd1e8a44abe9fb80374922e24e2, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.502070 2190 consensus_queue.cc:260] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.502368 2190 ts_tablet_manager.cc:1428] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 08:30:24.502843 2189 tablet_bootstrap.cc:654] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.503337 2214 ts_tablet_manager.cc:1905] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:24.504381 2191 tablet_bootstrap.cc:492] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057: No bootstrap required, opened a new log
I20260808 08:30:24.504470 2191 ts_tablet_manager.cc:1397] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 08:30:24.504931 2191 raft_consensus.cc:348] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.505029 2191 raft_consensus.cc:374] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.505055 2191 raft_consensus.cc:729] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f0165b37cfe4613919b6fd7ee102057, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.505162 2191 consensus_queue.cc:260] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.505395 2191 ts_tablet_manager.cc:1428] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:30:24.507030 2214 ts_tablet_manager.cc:1918] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:24.507112 2214 log.cc:1196] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/81f5bd4c105d41e3a5d454856799452c
I20260808 08:30:24.507412 2214 ts_tablet_manager.cc:1939] T 81f5bd4c105d41e3a5d454856799452c P a47e6bd1e8a44abe9fb80374922e24e2: Deleting consensus metadata
I20260808 08:30:24.508929 2189 tablet_bootstrap.cc:492] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a: No bootstrap required, opened a new log
I20260808 08:30:24.509008 2189 ts_tablet_manager.cc:1397] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260808 08:30:24.509455 2189 raft_consensus.cc:348] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.509548 2189 raft_consensus.cc:374] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.509575 2189 raft_consensus.cc:729] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d349861c22470c88976a9a94cee87a, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.509673 2189 consensus_queue.cc:260] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.509889 2189 ts_tablet_manager.cc:1428] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:30:24.511065 1649 catalog_manager.cc:4841] TS a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327): tablet 81f5bd4c105d41e3a5d454856799452c (table test-table [id=0349cefd929a434b9ed9f68aacf7b161]) successfully deleted
I20260808 08:30:24.551957 2197 raft_consensus.cc:482] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:24.552114 2197 raft_consensus.cc:504] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.553349 2197 leader_election.cc:288] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327), d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237)
I20260808 08:30:24.558127 2188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.554105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:34627 (local address 127.25.170.3:42237)
0808 08:30:24.554225 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.554232 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.554446 (+ 214us) server_negotiation.cc:407] Connection header received
0808 08:30:24.554591 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.554594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.554646 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.554692 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:24.555142 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.555822 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.556915 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.557494 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.557615 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.557671 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.557916 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.558000 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:30:24.558298 2185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.553688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:42883 (local address 127.25.170.1:34327)
0808 08:30:24.553847 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.553851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.554116 (+ 265us) server_negotiation.cc:407] Connection header received
0808 08:30:24.554355 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.554358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.554434 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.554510 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:24.554813 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.555548 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.557129 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.557741 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.557874 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.557923 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.558118 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.558195 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:30:24.558326 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.553603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:34327 (local address 127.25.170.2:42883)
0808 08:30:24.554005 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.554022 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.554202 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.554525 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.554528 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.554545 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:24.554687 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.554693 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.555672 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.555676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.556998 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.557009 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.557869 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.557873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.557982 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.558003 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.558099 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.558168 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":44,"thread_start_us":100,"threads_started":1}
I20260808 08:30:24.558487 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.553971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:42237 (local address 127.25.170.2:34627)
0808 08:30:24.554343 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.554357 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.554458 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.554825 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.554828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.554843 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:24.555009 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.555015 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.555947 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.555953 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.556780 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.556790 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.557640 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.557644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.557758 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.557786 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.558261 (+ 475us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.558346 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":94,"threads_started":1}
I20260808 08:30:24.559146 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43925a32e8db45a1b010c442e5ab6a0a" candidate_uuid: "5f0165b37cfe4613919b6fd7ee102057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d349861c22470c88976a9a94cee87a" is_pre_election: true
I20260808 08:30:24.559165 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43925a32e8db45a1b010c442e5ab6a0a" candidate_uuid: "5f0165b37cfe4613919b6fd7ee102057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" is_pre_election: true
I20260808 08:30:24.559329 1823 raft_consensus.cc:2454] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f0165b37cfe4613919b6fd7ee102057 in term 0.
I20260808 08:30:24.559406 2112 raft_consensus.cc:2454] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f0165b37cfe4613919b6fd7ee102057 in term 0.
I20260808 08:30:24.559744 1900 leader_election.cc:302] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f0165b37cfe4613919b6fd7ee102057, a47e6bd1e8a44abe9fb80374922e24e2; no voters:
I20260808 08:30:24.560022 2197 raft_consensus.cc:2781] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:30:24.560088 2197 raft_consensus.cc:482] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:30:24.560127 2197 raft_consensus.cc:3037] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.561393 2197 raft_consensus.cc:504] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.561746 2197 leader_election.cc:288] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [CANDIDATE]: Term 1 election: Requested vote from peers a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327), d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237)
I20260808 08:30:24.562203 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43925a32e8db45a1b010c442e5ab6a0a" candidate_uuid: "5f0165b37cfe4613919b6fd7ee102057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d349861c22470c88976a9a94cee87a"
I20260808 08:30:24.562340 2112 raft_consensus.cc:3037] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.563352 2112 raft_consensus.cc:2454] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f0165b37cfe4613919b6fd7ee102057 in term 1.
I20260808 08:30:24.563593 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43925a32e8db45a1b010c442e5ab6a0a" candidate_uuid: "5f0165b37cfe4613919b6fd7ee102057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47e6bd1e8a44abe9fb80374922e24e2"
I20260808 08:30:24.563719 1823 raft_consensus.cc:3037] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.564633 1823 raft_consensus.cc:2454] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f0165b37cfe4613919b6fd7ee102057 in term 1.
I20260808 08:30:24.564946 1900 leader_election.cc:302] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f0165b37cfe4613919b6fd7ee102057, d7d349861c22470c88976a9a94cee87a; no voters:
I20260808 08:30:24.565121 2197 raft_consensus.cc:2781] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:24.565387 2197 raft_consensus.cc:686] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 1 LEADER]: Becoming Leader. State: Replica: 5f0165b37cfe4613919b6fd7ee102057, State: Running, Role: LEADER
I20260808 08:30:24.565641 2197 consensus_queue.cc:237] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.568076 1661 catalog_manager.cc:5495] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2). New cstate: current_term: 1 leader_uuid: "5f0165b37cfe4613919b6fd7ee102057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } health_report { overall_health: UNKNOWN } } }
Aug 08 08:30:24 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177823, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.62@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:24.603072 2227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.593543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41879 (local address 127.0.0.1:57784)
0808 08:30:24.593864 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.593888 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.593987 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.594276 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.594279 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.594642 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:24.594731 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.594738 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.595825 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.595827 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.596388 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.596396 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.596960 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.596962 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.597023 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.597628 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:24.597639 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:24.599289 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:24.601289 (+ 2000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:24.601298 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:24.601302 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:24.601571 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:24.601888 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:24.601890 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:24.601892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:24.601969 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:24.602419 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:24.602427 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:24.602532 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.602654 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.602860 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":118,"threads_started":1}
I20260808 08:30:24.603072 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.593616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57784 (local address 127.25.170.62:41879)
0808 08:30:24.593933 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.593942 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.593960 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:30:24.594086 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.594090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.594139 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.594245 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:24.594852 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.595704 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.596507 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.596845 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.596958 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.599425 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:24.599432 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:24.599436 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:24.599464 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:24.601183 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:24.601687 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:24.601691 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:24.601693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:24.601792 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:24.602114 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:24.602117 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:24.602119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:24.602296 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:24.602419 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.602759 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.602908 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":141,"threads_started":1}
I20260808 08:30:24.607106 1661 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:57784:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:30:24.607823 1661 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:30:24.612845 1803 tablet_service.cc:1467] Processing CreateTablet for tablet 58b5545e49a14c28aeaa5e6df1378acd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c835e3b1cc274aecbe87ee15ab573e4e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:30:24.612963 1947 tablet_service.cc:1467] Processing CreateTablet for tablet 58b5545e49a14c28aeaa5e6df1378acd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c835e3b1cc274aecbe87ee15ab573e4e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:30:24.613034 2081 tablet_service.cc:1467] Processing CreateTablet for tablet 58b5545e49a14c28aeaa5e6df1378acd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c835e3b1cc274aecbe87ee15ab573e4e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:30:24.613270 1803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b5545e49a14c28aeaa5e6df1378acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.613384 2081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b5545e49a14c28aeaa5e6df1378acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.613382 1947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b5545e49a14c28aeaa5e6df1378acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.616183 2189 tablet_bootstrap.cc:492] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: Bootstrap starting.
I20260808 08:30:24.616351 2190 tablet_bootstrap.cc:492] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: Bootstrap starting.
I20260808 08:30:24.617213 2190 tablet_bootstrap.cc:654] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.617213 2189 tablet_bootstrap.cc:654] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.618299 2191 tablet_bootstrap.cc:492] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: Bootstrap starting.
I20260808 08:30:24.619010 2190 tablet_bootstrap.cc:492] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: No bootstrap required, opened a new log
I20260808 08:30:24.619104 2190 ts_tablet_manager.cc:1397] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 08:30:24.619357 2191 tablet_bootstrap.cc:654] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.619604 2190 raft_consensus.cc:348] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.619738 2190 raft_consensus.cc:374] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.619783 2190 raft_consensus.cc:729] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a47e6bd1e8a44abe9fb80374922e24e2, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.619963 2190 consensus_queue.cc:260] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.620252 2190 ts_tablet_manager.cc:1428] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260808 08:30:24.620747 2196 tablet_replica.cc:439] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } } }
I20260808 08:30:24.620899 2196 tablet_replica.cc:442] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:30:24.620967 2191 tablet_bootstrap.cc:492] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: No bootstrap required, opened a new log
I20260808 08:30:24.621057 2191 ts_tablet_manager.cc:1397] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 08:30:24.621500 2191 raft_consensus.cc:348] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.621615 2191 raft_consensus.cc:374] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.621649 2191 raft_consensus.cc:729] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f0165b37cfe4613919b6fd7ee102057, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.621769 2191 consensus_queue.cc:260] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.622021 2191 ts_tablet_manager.cc:1428] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 08:30:24.622027 2197 tablet_replica.cc:439] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } } }
I20260808 08:30:24.622632 2197 tablet_replica.cc:442] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:30:24.623659 2189 tablet_bootstrap.cc:492] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: No bootstrap required, opened a new log
I20260808 08:30:24.623750 2189 ts_tablet_manager.cc:1397] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260808 08:30:24.624245 2189 raft_consensus.cc:348] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.624356 2189 raft_consensus.cc:374] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.624394 2189 raft_consensus.cc:729] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d349861c22470c88976a9a94cee87a, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.624513 2189 consensus_queue.cc:260] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.624845 2189 ts_tablet_manager.cc:1428] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 08:30:24.624790 2210 tablet_replica.cc:439] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } } }
I20260808 08:30:24.624943 2210 tablet_replica.cc:442] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:30:24.691725 2197 raft_consensus.cc:482] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:24.691860 2197 raft_consensus.cc:504] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.692301 2197 leader_election.cc:288] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327), d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237)
I20260808 08:30:24.692806 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b5545e49a14c28aeaa5e6df1378acd" candidate_uuid: "5f0165b37cfe4613919b6fd7ee102057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" is_pre_election: true
I20260808 08:30:24.692870 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b5545e49a14c28aeaa5e6df1378acd" candidate_uuid: "5f0165b37cfe4613919b6fd7ee102057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d349861c22470c88976a9a94cee87a" is_pre_election: true
I20260808 08:30:24.692981 1823 raft_consensus.cc:2454] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f0165b37cfe4613919b6fd7ee102057 in term 0.
I20260808 08:30:24.693059 2112 raft_consensus.cc:2454] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f0165b37cfe4613919b6fd7ee102057 in term 0.
I20260808 08:30:24.693333 1900 leader_election.cc:302] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f0165b37cfe4613919b6fd7ee102057, a47e6bd1e8a44abe9fb80374922e24e2; no voters:
I20260808 08:30:24.693540 2197 raft_consensus.cc:2781] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:30:24.693602 2197 raft_consensus.cc:482] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:30:24.693629 2197 raft_consensus.cc:3037] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.694685 2197 raft_consensus.cc:504] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.695011 2197 leader_election.cc:288] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [CANDIDATE]: Term 1 election: Requested vote from peers a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327), d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237)
I20260808 08:30:24.695396 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b5545e49a14c28aeaa5e6df1378acd" candidate_uuid: "5f0165b37cfe4613919b6fd7ee102057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47e6bd1e8a44abe9fb80374922e24e2"
I20260808 08:30:24.695461 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b5545e49a14c28aeaa5e6df1378acd" candidate_uuid: "5f0165b37cfe4613919b6fd7ee102057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d349861c22470c88976a9a94cee87a"
I20260808 08:30:24.695539 1823 raft_consensus.cc:3037] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.695591 2112 raft_consensus.cc:3037] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.696533 1823 raft_consensus.cc:2454] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f0165b37cfe4613919b6fd7ee102057 in term 1.
I20260808 08:30:24.696587 2112 raft_consensus.cc:2454] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f0165b37cfe4613919b6fd7ee102057 in term 1.
I20260808 08:30:24.696834 1900 leader_election.cc:302] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f0165b37cfe4613919b6fd7ee102057, a47e6bd1e8a44abe9fb80374922e24e2; no voters:
I20260808 08:30:24.697031 2197 raft_consensus.cc:2781] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:24.697139 2197 raft_consensus.cc:686] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [term 1 LEADER]: Becoming Leader. State: Replica: 5f0165b37cfe4613919b6fd7ee102057, State: Running, Role: LEADER
I20260808 08:30:24.697286 2197 consensus_queue.cc:237] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.698035 2220 tablet_replica.cc:439] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: TxnStatusTablet state changed. Reason: New leader 5f0165b37cfe4613919b6fd7ee102057. Latest consensus state: current_term: 1 leader_uuid: "5f0165b37cfe4613919b6fd7ee102057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } } }
I20260808 08:30:24.698159 2220 tablet_replica.cc:442] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:30:24.698498 2233 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:30:24.698675 2233 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:30:24.699084 1660 catalog_manager.cc:5495] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2). New cstate: current_term: 1 leader_uuid: "5f0165b37cfe4613919b6fd7ee102057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } health_report { overall_health: UNKNOWN } } }
I20260808 08:30:24.728235 2187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.723854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41084 (local address 127.25.170.2:33297)
0808 08:30:24.723993 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.723997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.724011 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:24.724082 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.724085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.724144 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.724247 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:24.724503 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.725285 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.726549 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.726899 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.727004 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.727322 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:24.727819 (+ 497us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:24.727966 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.728048 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.728104 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:30:24.728248 2227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.723646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:33297 (local address 127.0.0.1:41084)
0808 08:30:24.723796 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.723812 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.723947 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.724266 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.724269 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.724276 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:30:24.724386 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.724391 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.725426 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.725429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.726411 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.726421 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.727013 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.727016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.727110 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.727163 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:30:24.727948 (+ 785us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:30:24.727963 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.728035 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.728117 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 08:30:24.731566 2112 raft_consensus.cc:1261] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Refusing update from remote peer 5f0165b37cfe4613919b6fd7ee102057: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:24.731389 1823 raft_consensus.cc:1261] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Refusing update from remote peer 5f0165b37cfe4613919b6fd7ee102057: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:24.732546 2197 consensus_queue.cc:1035] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:24.732796 2220 consensus_queue.cc:1035] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:24.734320 2196 tablet_replica.cc:439] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: TxnStatusTablet state changed. Reason: New leader 5f0165b37cfe4613919b6fd7ee102057. Latest consensus state: current_term: 1 leader_uuid: "5f0165b37cfe4613919b6fd7ee102057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } } }
I20260808 08:30:24.734448 2196 tablet_replica.cc:442] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:30:24.734556 2210 tablet_replica.cc:439] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: TxnStatusTablet state changed. Reason: New leader 5f0165b37cfe4613919b6fd7ee102057. Latest consensus state: current_term: 1 leader_uuid: "5f0165b37cfe4613919b6fd7ee102057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } } }
I20260808 08:30:24.734654 2210 tablet_replica.cc:442] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:30:24.736503 2197 tablet_replica.cc:439] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f0165b37cfe4613919b6fd7ee102057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } } }
I20260808 08:30:24.736606 2197 tablet_replica.cc:442] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:30:24.737934 2220 tablet_replica.cc:439] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f0165b37cfe4613919b6fd7ee102057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } } }
I20260808 08:30:24.738041 2220 tablet_replica.cc:442] T 58b5545e49a14c28aeaa5e6df1378acd P 5f0165b37cfe4613919b6fd7ee102057: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:30:24.739281 2210 tablet_replica.cc:439] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f0165b37cfe4613919b6fd7ee102057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } } }
I20260808 08:30:24.739403 2210 tablet_replica.cc:442] T 58b5545e49a14c28aeaa5e6df1378acd P d7d349861c22470c88976a9a94cee87a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:30:24.739615 2196 tablet_replica.cc:439] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f0165b37cfe4613919b6fd7ee102057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } } }
I20260808 08:30:24.739718 2196 tablet_replica.cc:442] T 58b5545e49a14c28aeaa5e6df1378acd P a47e6bd1e8a44abe9fb80374922e24e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:30:24.745385 2187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.741585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41086 (local address 127.25.170.2:33297)
0808 08:30:24.741692 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.741697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.741708 (+ 11us) server_negotiation.cc:407] Connection header received
0808 08:30:24.741746 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.741749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.741792 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.741857 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:24.742199 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.742958 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.743823 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.744221 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.744345 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.744735 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:24.744955 (+ 220us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:24.745025 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.745203 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.745251 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 08:30:24.755841 2187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.752098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:59967 (local address 127.25.170.2:33297)
0808 08:30:24.752197 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.752201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.752474 (+ 273us) server_negotiation.cc:407] Connection header received
0808 08:30:24.752634 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.752637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.752702 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.752787 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:24.753065 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.753516 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.754779 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.755037 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.755128 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.755454 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:24.755509 (+ 55us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:24.755562 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.755680 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.755717 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":38}
I20260808 08:30:24.755970 2240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.752028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:33297 (local address 127.25.170.2:59967)
0808 08:30:24.752375 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.752391 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.752510 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.752805 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.752808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.752817 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:30:24.752959 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.752965 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.753618 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.753622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.754648 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.754660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.755159 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.755163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.755275 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.755325 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:30:24.755589 (+ 264us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:30:24.755596 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.755659 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.755731 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":15,"thread_start_us":100,"threads_started":1}
I20260808 08:30:24.762229 2112 raft_consensus.cc:1261] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Refusing update from remote peer 5f0165b37cfe4613919b6fd7ee102057: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:24.762323 1823 raft_consensus.cc:1261] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Refusing update from remote peer 5f0165b37cfe4613919b6fd7ee102057: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:24.762617 2220 consensus_queue.cc:1035] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:24.762795 2241 consensus_queue.cc:1035] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:24.800117 1660 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:24.800288 1660 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:24.802438 1660 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2: Sending DeleteTablet for 3 replicas of tablet 43925a32e8db45a1b010c442e5ab6a0a
I20260808 08:30:24.802971 1803 tablet_service.cc:1514] Processing DeleteTablet for tablet 43925a32e8db45a1b010c442e5ab6a0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:24 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:34770
I20260808 08:30:24.803025 2081 tablet_service.cc:1514] Processing DeleteTablet for tablet 43925a32e8db45a1b010c442e5ab6a0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:24 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:39338
I20260808 08:30:24.803154 2214 tablet_replica.cc:330] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2: stopping tablet replica
I20260808 08:30:24.803210 2213 tablet_replica.cc:330] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a: stopping tablet replica
I20260808 08:30:24.803282 2214 raft_consensus.cc:2229] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:24.803335 2213 raft_consensus.cc:2229] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:24.803411 2214 raft_consensus.cc:2258] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:24.803457 2213 raft_consensus.cc:2258] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:24.803607 1946 tablet_service.cc:1514] Processing DeleteTablet for tablet 43925a32e8db45a1b010c442e5ab6a0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:24 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:41076
I20260808 08:30:24.803774 2212 tablet_replica.cc:330] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057: stopping tablet replica
I20260808 08:30:24.804025 2212 raft_consensus.cc:2229] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:30:24.804271 2214 ts_tablet_manager.cc:1905] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:24.804328 2212 raft_consensus.cc:2258] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:24.804984 2212 ts_tablet_manager.cc:1905] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:24.807201 2214 ts_tablet_manager.cc:1918] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:30:24.807284 2214 log.cc:1196] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/43925a32e8db45a1b010c442e5ab6a0a
I20260808 08:30:24.807546 2214 ts_tablet_manager.cc:1939] T 43925a32e8db45a1b010c442e5ab6a0a P a47e6bd1e8a44abe9fb80374922e24e2: Deleting consensus metadata
I20260808 08:30:24.807837 2212 ts_tablet_manager.cc:1918] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:30:24.807933 2212 log.cc:1196] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/43925a32e8db45a1b010c442e5ab6a0a
I20260808 08:30:24.808192 2212 ts_tablet_manager.cc:1939] T 43925a32e8db45a1b010c442e5ab6a0a P 5f0165b37cfe4613919b6fd7ee102057: Deleting consensus metadata
I20260808 08:30:24.808378 2213 ts_tablet_manager.cc:1905] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:24.808867 1648 catalog_manager.cc:4841] TS 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297): tablet 43925a32e8db45a1b010c442e5ab6a0a (table test-table [id=d6ebd7b84b52424a9cef22b6f9d8d27c]) successfully deleted
I20260808 08:30:24.810557 2213 ts_tablet_manager.cc:1918] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:30:24.810621 2213 log.cc:1196] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/43925a32e8db45a1b010c442e5ab6a0a
I20260808 08:30:24.810863 2213 ts_tablet_manager.cc:1939] T 43925a32e8db45a1b010c442e5ab6a0a P d7d349861c22470c88976a9a94cee87a: Deleting consensus metadata
I20260808 08:30:24.811468 1649 catalog_manager.cc:4841] TS d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237): tablet 43925a32e8db45a1b010c442e5ab6a0a (table test-table [id=d6ebd7b84b52424a9cef22b6f9d8d27c]) successfully deleted
I20260808 08:30:24.811964 1649 catalog_manager.cc:4841] TS a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327): tablet 43925a32e8db45a1b010c442e5ab6a0a (table test-table [id=d6ebd7b84b52424a9cef22b6f9d8d27c]) successfully deleted
Aug 08 08:30:24 dist-test-slave-zkpd krb5kdc[1615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:30:24 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:24 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:30:24.839438 2228 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:24.832703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57798 (local address 127.25.170.62:41879)
0808 08:30:24.832866 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.832871 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.832999 (+ 128us) server_negotiation.cc:407] Connection header received
0808 08:30:24.833120 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.833124 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.833179 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.833277 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:24.833927 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.834837 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.835669 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.836047 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.836164 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.839309 (+ 3145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57798: BlockingRecv error: recv got EOF from 127.0.0.1:57798 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 08:30:24 dist-test-slave-zkpd krb5kdc[1615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM
I20260808 08:30:24.849335 2228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.840821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57802 (local address 127.25.170.62:41879)
0808 08:30:24.840935 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.840939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.841086 (+ 147us) server_negotiation.cc:407] Connection header received
0808 08:30:24.841237 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.841239 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.841281 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.841362 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:24.841914 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.842396 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.843151 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.843413 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.843519 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.846094 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:24.846097 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:24.846099 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:24.846122 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:24.847505 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:24.848058 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:24.848061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:24.848062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:24.848135 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:24.848430 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:24.848432 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:24.848433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:24.848590 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:24.848688 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.848988 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.849080 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 08:30:24.852105 1660 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:30:24.852540 1660 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:30:24.857656 1803 tablet_service.cc:1467] Processing CreateTablet for tablet b7051c1d8371454f839f3f623f207470 (DEFAULT_TABLE table=test-table [id=0d519f4637ea4fdf83dfcbfec2a4a68f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.857846 1946 tablet_service.cc:1467] Processing CreateTablet for tablet b7051c1d8371454f839f3f623f207470 (DEFAULT_TABLE table=test-table [id=0d519f4637ea4fdf83dfcbfec2a4a68f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.857997 1803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7051c1d8371454f839f3f623f207470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.858125 1946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7051c1d8371454f839f3f623f207470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.859982 2190 tablet_bootstrap.cc:492] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2: Bootstrap starting.
I20260808 08:30:24.860347 2081 tablet_service.cc:1467] Processing CreateTablet for tablet b7051c1d8371454f839f3f623f207470 (DEFAULT_TABLE table=test-table [id=0d519f4637ea4fdf83dfcbfec2a4a68f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.860607 2191 tablet_bootstrap.cc:492] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057: Bootstrap starting.
I20260808 08:30:24.860633 2081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7051c1d8371454f839f3f623f207470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.860952 2190 tablet_bootstrap.cc:654] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.861843 2191 tablet_bootstrap.cc:654] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.863075 2189 tablet_bootstrap.cc:492] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a: Bootstrap starting.
I20260808 08:30:24.863091 2191 tablet_bootstrap.cc:492] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057: No bootstrap required, opened a new log
I20260808 08:30:24.863163 2191 ts_tablet_manager.cc:1397] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 08:30:24.863590 2191 raft_consensus.cc:348] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.863698 2191 raft_consensus.cc:374] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.863739 2191 raft_consensus.cc:729] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f0165b37cfe4613919b6fd7ee102057, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.863853 2191 consensus_queue.cc:260] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.863956 2189 tablet_bootstrap.cc:654] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.864296 2190 tablet_bootstrap.cc:492] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2: No bootstrap required, opened a new log
I20260808 08:30:24.864389 2190 ts_tablet_manager.cc:1397] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260808 08:30:24.864830 2190 raft_consensus.cc:348] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.864953 2190 raft_consensus.cc:374] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.864987 2190 raft_consensus.cc:729] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a47e6bd1e8a44abe9fb80374922e24e2, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.865119 2190 consensus_queue.cc:260] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.865388 2190 ts_tablet_manager.cc:1428] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 08:30:24.866036 2191 ts_tablet_manager.cc:1428] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260808 08:30:24.867403 2189 tablet_bootstrap.cc:492] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a: No bootstrap required, opened a new log
I20260808 08:30:24.867487 2189 ts_tablet_manager.cc:1397] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260808 08:30:24.867866 2189 raft_consensus.cc:348] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.868002 2189 raft_consensus.cc:374] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.868041 2189 raft_consensus.cc:729] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d349861c22470c88976a9a94cee87a, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.868160 2189 consensus_queue.cc:260] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.868435 2189 ts_tablet_manager.cc:1428] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 08:30:24.870435 2210 raft_consensus.cc:482] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:24.870554 2210 raft_consensus.cc:504] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.870955 2210 leader_election.cc:288] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327), 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297)
I20260808 08:30:24.871299 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7051c1d8371454f839f3f623f207470" candidate_uuid: "d7d349861c22470c88976a9a94cee87a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" is_pre_election: true
I20260808 08:30:24.871435 1823 raft_consensus.cc:2454] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7d349861c22470c88976a9a94cee87a in term 0.
I20260808 08:30:24.871455 1966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7051c1d8371454f839f3f623f207470" candidate_uuid: "d7d349861c22470c88976a9a94cee87a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f0165b37cfe4613919b6fd7ee102057" is_pre_election: true
I20260808 08:30:24.871582 1966 raft_consensus.cc:2454] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7d349861c22470c88976a9a94cee87a in term 0.
I20260808 08:30:24.871690 2043 leader_election.cc:302] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a47e6bd1e8a44abe9fb80374922e24e2, d7d349861c22470c88976a9a94cee87a; no voters:
I20260808 08:30:24.871937 2210 raft_consensus.cc:2781] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:30:24.872007 2210 raft_consensus.cc:482] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:30:24.872049 2210 raft_consensus.cc:3037] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.873116 2210 raft_consensus.cc:504] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.873481 2210 leader_election.cc:288] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [CANDIDATE]: Term 1 election: Requested vote from peers a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327), 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297)
I20260808 08:30:24.873801 1823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7051c1d8371454f839f3f623f207470" candidate_uuid: "d7d349861c22470c88976a9a94cee87a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47e6bd1e8a44abe9fb80374922e24e2"
I20260808 08:30:24.873917 1823 raft_consensus.cc:3037] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.875078 1823 raft_consensus.cc:2454] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7d349861c22470c88976a9a94cee87a in term 1.
I20260808 08:30:24.875331 1966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7051c1d8371454f839f3f623f207470" candidate_uuid: "d7d349861c22470c88976a9a94cee87a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f0165b37cfe4613919b6fd7ee102057"
I20260808 08:30:24.875368 2043 leader_election.cc:302] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a47e6bd1e8a44abe9fb80374922e24e2, d7d349861c22470c88976a9a94cee87a; no voters:
I20260808 08:30:24.875448 1966 raft_consensus.cc:3037] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.875567 2210 raft_consensus.cc:2781] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:24.875669 2210 raft_consensus.cc:686] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 1 LEADER]: Becoming Leader. State: Replica: d7d349861c22470c88976a9a94cee87a, State: Running, Role: LEADER
I20260808 08:30:24.875823 2210 consensus_queue.cc:237] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.876720 1966 raft_consensus.cc:2454] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7d349861c22470c88976a9a94cee87a in term 1.
I20260808 08:30:24.877568 1661 catalog_manager.cc:5495] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a reported cstate change: term changed from 0 to 1, leader changed from <none> to d7d349861c22470c88976a9a94cee87a (127.25.170.3). New cstate: current_term: 1 leader_uuid: "d7d349861c22470c88976a9a94cee87a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } health_report { overall_health: HEALTHY } } }
I20260808 08:30:24.889928 2188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.886777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39362 (local address 127.25.170.3:42237)
0808 08:30:24.886905 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.886909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.886923 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:24.887025 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.887028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.887076 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.887156 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:24.887396 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.888023 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.888875 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.889097 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.889207 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.889476 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:24.889544 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:24.889623 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.889741 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.889796 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:30:24.891801 1966 raft_consensus.cc:1261] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Refusing update from remote peer d7d349861c22470c88976a9a94cee87a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:24.891947 1823 raft_consensus.cc:1261] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Refusing update from remote peer d7d349861c22470c88976a9a94cee87a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:24.892346 2199 consensus_queue.cc:1035] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:24.892468 2210 consensus_queue.cc:1035] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:24.899444 1661 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:24.899577 1661 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:24.901762 1661 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2: Sending DeleteTablet for 3 replicas of tablet b7051c1d8371454f839f3f623f207470
I20260808 08:30:24.902258 1946 tablet_service.cc:1514] Processing DeleteTablet for tablet b7051c1d8371454f839f3f623f207470 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:24 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:41076
I20260808 08:30:24.902490 2212 tablet_replica.cc:330] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057: stopping tablet replica
I20260808 08:30:24.902805 2212 raft_consensus.cc:2229] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:24.902935 2212 raft_consensus.cc:2258] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:24.903227 1946 tablet_service.cc:1514] Processing DeleteTablet for tablet b7051c1d8371454f839f3f623f207470 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:24 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:41076
I20260808 08:30:24.903575 2212 ts_tablet_manager.cc:1905] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:24.903751 1803 tablet_service.cc:1514] Processing DeleteTablet for tablet b7051c1d8371454f839f3f623f207470 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:24 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:34770
I20260808 08:30:24.903947 2214 tablet_replica.cc:330] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2: stopping tablet replica
I20260808 08:30:24.903942 2081 tablet_service.cc:1514] Processing DeleteTablet for tablet b7051c1d8371454f839f3f623f207470 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:24 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:39338
I20260808 08:30:24.904063 2214 raft_consensus.cc:2229] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:24.904098 2213 tablet_replica.cc:330] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a: stopping tablet replica
I20260808 08:30:24.904174 2214 raft_consensus.cc:2258] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:24.904188 2213 raft_consensus.cc:2229] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:30:24.904346 2213 raft_consensus.cc:2258] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:24.904990 2214 ts_tablet_manager.cc:1905] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:24.905535 1661 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:30:24.905900 1661 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:30:24.906047 2212 ts_tablet_manager.cc:1918] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:24.906111 2212 log.cc:1196] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/b7051c1d8371454f839f3f623f207470
I20260808 08:30:24.906360 2212 ts_tablet_manager.cc:1939] T b7051c1d8371454f839f3f623f207470 P 5f0165b37cfe4613919b6fd7ee102057: Deleting consensus metadata
I20260808 08:30:24.907017 2213 ts_tablet_manager.cc:1905] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:24.907306 2214 ts_tablet_manager.cc:1918] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:24.907359 2214 log.cc:1196] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/b7051c1d8371454f839f3f623f207470
I20260808 08:30:24.907536 2214 ts_tablet_manager.cc:1939] T b7051c1d8371454f839f3f623f207470 P a47e6bd1e8a44abe9fb80374922e24e2: Deleting consensus metadata
I20260808 08:30:24.908875 1649 catalog_manager.cc:4841] TS a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327): tablet b7051c1d8371454f839f3f623f207470 (table test-table [id=0d519f4637ea4fdf83dfcbfec2a4a68f]) successfully deleted
I20260808 08:30:24.909286 2213 ts_tablet_manager.cc:1918] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:24.909364 2213 log.cc:1196] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/b7051c1d8371454f839f3f623f207470
I20260808 08:30:24.909614 2213 ts_tablet_manager.cc:1939] T b7051c1d8371454f839f3f623f207470 P d7d349861c22470c88976a9a94cee87a: Deleting consensus metadata
I20260808 08:30:24.910290 1649 catalog_manager.cc:4841] TS d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237): tablet b7051c1d8371454f839f3f623f207470 (table test-table [id=0d519f4637ea4fdf83dfcbfec2a4a68f]) successfully deleted
I20260808 08:30:24.911811 1648 catalog_manager.cc:4841] TS 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297): tablet b7051c1d8371454f839f3f623f207470 (table test-table [id=0d519f4637ea4fdf83dfcbfec2a4a68f]) successfully deleted
I20260808 08:30:24.913285 1803 tablet_service.cc:1467] Processing CreateTablet for tablet 529cf422760147a591610e3bd4f78da5 (DEFAULT_TABLE table=test-table [id=579ed3640f404e1e80166f22dc9bf1c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.913419 1946 tablet_service.cc:1467] Processing CreateTablet for tablet 529cf422760147a591610e3bd4f78da5 (DEFAULT_TABLE table=test-table [id=579ed3640f404e1e80166f22dc9bf1c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.913429 2081 tablet_service.cc:1467] Processing CreateTablet for tablet 529cf422760147a591610e3bd4f78da5 (DEFAULT_TABLE table=test-table [id=579ed3640f404e1e80166f22dc9bf1c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:24.913555 1803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 529cf422760147a591610e3bd4f78da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.913642 1946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 529cf422760147a591610e3bd4f78da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.913666 2081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 529cf422760147a591610e3bd4f78da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:24.915838 2191 tablet_bootstrap.cc:492] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057: Bootstrap starting.
I20260808 08:30:24.916023 2190 tablet_bootstrap.cc:492] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2: Bootstrap starting.
I20260808 08:30:24.916644 2191 tablet_bootstrap.cc:654] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.917183 2189 tablet_bootstrap.cc:492] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a: Bootstrap starting.
I20260808 08:30:24.917528 2190 tablet_bootstrap.cc:654] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.917981 2189 tablet_bootstrap.cc:654] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:24.918856 2190 tablet_bootstrap.cc:492] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2: No bootstrap required, opened a new log
W20260808 08:30:24.918916 1648 catalog_manager.cc:4808] TS 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297): delete failed for tablet b7051c1d8371454f839f3f623f207470 because the tablet was not found. No further retry: Not found: Tablet not found: b7051c1d8371454f839f3f623f207470
I20260808 08:30:24.918951 2190 ts_tablet_manager.cc:1397] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 08:30:24.919487 2190 raft_consensus.cc:348] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.919615 2190 raft_consensus.cc:374] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.919664 2190 raft_consensus.cc:729] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a47e6bd1e8a44abe9fb80374922e24e2, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.919842 2191 tablet_bootstrap.cc:492] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057: No bootstrap required, opened a new log
I20260808 08:30:24.919798 2190 consensus_queue.cc:260] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.919947 2191 ts_tablet_manager.cc:1397] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 08:30:24.920121 2190 ts_tablet_manager.cc:1428] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260808 08:30:24.920313 2191 raft_consensus.cc:348] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.920416 2191 raft_consensus.cc:374] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.920446 2191 raft_consensus.cc:729] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f0165b37cfe4613919b6fd7ee102057, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.920550 2191 consensus_queue.cc:260] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.920804 2191 ts_tablet_manager.cc:1428] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:30:24.921025 2189 tablet_bootstrap.cc:492] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a: No bootstrap required, opened a new log
I20260808 08:30:24.921110 2189 ts_tablet_manager.cc:1397] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 08:30:24.921563 2189 raft_consensus.cc:348] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.921700 2189 raft_consensus.cc:374] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:24.921741 2189 raft_consensus.cc:729] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d349861c22470c88976a9a94cee87a, State: Initialized, Role: FOLLOWER
I20260808 08:30:24.921880 2189 consensus_queue.cc:260] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.922170 2189 ts_tablet_manager.cc:1428] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:30:24.982879 2196 raft_consensus.cc:482] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:24.983052 2196 raft_consensus.cc:504] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.984336 2196 leader_election.cc:288] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297), d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237)
I20260808 08:30:24.989115 2269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.984611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:42237 (local address 127.25.170.1:46481)
0808 08:30:24.985262 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.985276 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.985421 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.985682 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.985685 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.985703 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:24.985937 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.985943 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.986863 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.986868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.987774 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.987784 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.988660 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.988663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.988769 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.988797 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.988874 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.988943 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":55,"thread_start_us":117,"threads_started":1}
I20260808 08:30:24.989116 2188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.984711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:46481 (local address 127.25.170.3:42237)
0808 08:30:24.984865 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.984872 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.985350 (+ 478us) server_negotiation.cc:407] Connection header received
0808 08:30:24.985534 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.985538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.985594 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.985669 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:24.986062 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.986750 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.987918 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.988518 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.988648 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.988704 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.988906 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.988987 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:30:24.989734 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529cf422760147a591610e3bd4f78da5" candidate_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d349861c22470c88976a9a94cee87a" is_pre_election: true
I20260808 08:30:24.989872 2187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.984959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:48609 (local address 127.25.170.2:33297)
0808 08:30:24.985104 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:24.985108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:24.985123 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:30:24.985352 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:24.985356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:24.985409 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:24.985488 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:24.986104 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.986885 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.988528 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.989097 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.989220 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.989272 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:24.989635 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 08:30:24.989727 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:30:24.989897 2112 raft_consensus.cc:2454] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a47e6bd1e8a44abe9fb80374922e24e2 in term 0.
I20260808 08:30:24.990291 2270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:24.984524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:33297 (local address 127.25.170.1:48609)
0808 08:30:24.985035 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:24.985051 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:24.985169 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:24.985608 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:24.985611 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:24.985631 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:24.985897 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.985905 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.987160 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.987163 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.988390 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:24.988401 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:24.989348 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:24.989353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:24.989487 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:24.989512 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:30:24.990063 (+ 551us) client_negotiation.cc:240] Negotiation successful
0808 08:30:24.990158 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":73,"thread_start_us":115,"threads_started":1}
I20260808 08:30:24.990284 1757 leader_election.cc:302] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a47e6bd1e8a44abe9fb80374922e24e2, d7d349861c22470c88976a9a94cee87a; no voters:
I20260808 08:30:24.990548 2196 raft_consensus.cc:2781] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:30:24.990610 2196 raft_consensus.cc:482] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:30:24.990648 2196 raft_consensus.cc:3037] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.991720 2196 raft_consensus.cc:504] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.992189 2196 leader_election.cc:288] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [CANDIDATE]: Term 1 election: Requested vote from peers 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297), d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237)
I20260808 08:30:24.992393 1966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529cf422760147a591610e3bd4f78da5" candidate_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f0165b37cfe4613919b6fd7ee102057" is_pre_election: true
I20260808 08:30:24.992473 1967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529cf422760147a591610e3bd4f78da5" candidate_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f0165b37cfe4613919b6fd7ee102057"
I20260808 08:30:24.992537 1966 raft_consensus.cc:2454] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a47e6bd1e8a44abe9fb80374922e24e2 in term 0.
I20260808 08:30:24.993036 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "529cf422760147a591610e3bd4f78da5" candidate_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7d349861c22470c88976a9a94cee87a"
I20260808 08:30:24.993158 2112 raft_consensus.cc:3037] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:24.994355 2112 raft_consensus.cc:2454] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a47e6bd1e8a44abe9fb80374922e24e2 in term 1.
I20260808 08:30:24.994630 1757 leader_election.cc:302] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a47e6bd1e8a44abe9fb80374922e24e2, d7d349861c22470c88976a9a94cee87a; no voters: 5f0165b37cfe4613919b6fd7ee102057
I20260808 08:30:24.994807 2196 raft_consensus.cc:2781] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:24.995067 2196 raft_consensus.cc:686] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 LEADER]: Becoming Leader. State: Replica: a47e6bd1e8a44abe9fb80374922e24e2, State: Running, Role: LEADER
I20260808 08:30:24.995349 2196 consensus_queue.cc:237] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } }
I20260808 08:30:24.997815 1662 catalog_manager.cc:5495] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1). New cstate: current_term: 1 leader_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47e6bd1e8a44abe9fb80374922e24e2" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 } health_report { overall_health: UNKNOWN } } }
I20260808 08:30:25.029593 2185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:25.025874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34782 (local address 127.25.170.1:34327)
0808 08:30:25.026007 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:25.026011 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:25.026040 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:30:25.026112 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:25.026114 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:25.026170 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:25.026259 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:25.026517 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:25.027012 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:25.028174 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:25.028396 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:25.028478 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:25.028752 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:25.029218 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:25.029319 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:25.029403 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 08:30:25.029449 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:30:25.040138 2187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:25.036665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:60279 (local address 127.25.170.2:33297)
0808 08:30:25.036803 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:25.036806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:25.037060 (+ 254us) server_negotiation.cc:407] Connection header received
0808 08:30:25.037214 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:25.037218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:25.037279 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:25.037358 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:25.037621 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:25.038113 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:25.038988 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:25.039215 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:25.039333 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:25.039665 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:25.039733 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:25.039821 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:25.039947 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 08:30:25.040000 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 08:30:25.040164 2276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:25.036569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:33297 (local address 127.25.170.1:60279)
0808 08:30:25.036966 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:25.036978 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:25.037111 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:25.037384 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:25.037387 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:25.037396 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:30:25.037516 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:25.037520 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:25.038223 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:25.038229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:25.038868 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:25.038877 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:25.039360 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:25.039366 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:25.039453 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:25.039494 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:30:25.039825 (+ 331us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:30:25.039834 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:30:25.039934 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 08:30:25.040012 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":108,"threads_started":1}
I20260808 08:30:25.046343 2112 raft_consensus.cc:1261] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Refusing update from remote peer a47e6bd1e8a44abe9fb80374922e24e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:25.046590 1967 raft_consensus.cc:3037] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:25.047953 1967 raft_consensus.cc:1261] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Refusing update from remote peer a47e6bd1e8a44abe9fb80374922e24e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:25.048229 2272 consensus_queue.cc:1035] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7d349861c22470c88976a9a94cee87a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:25.048406 2196 consensus_queue.cc:1035] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f0165b37cfe4613919b6fd7ee102057" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 33297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:25.051527 2204 mvcc.cc:205] Tried to move back new op lower bound from 7316184371385585664 to 7316184371183775744. Current Snapshot: MvccSnapshot[applied={T|T < 7316184371385585664}]
I20260808 08:30:25.065349 2185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:25.062223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:34467 (local address 127.25.170.1:34327)
0808 08:30:25.062393 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:25.062396 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:25.062407 (+ 11us) server_negotiation.cc:407] Connection header received
0808 08:30:25.062469 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:25.062471 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:25.062516 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:25.062594 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:25.062843 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:25.063346 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:25.064256 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:25.064534 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:25.064648 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:25.064930 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:25.065009 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:25.065087 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:25.065176 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 08:30:25.065222 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260808 08:30:25.065377 2240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:25.062007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:34327 (local address 127.25.170.2:34467)
0808 08:30:25.062145 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:25.062162 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:25.062236 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:25.062604 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:25.062607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:25.062614 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:30:25.062711 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:25.062716 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:25.063455 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:25.063458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:25.064135 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:25.064144 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:25.064665 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:25.064670 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:25.064768 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:25.064811 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:30:25.065092 (+ 281us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:30:25.065101 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:30:25.065166 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 08:30:25.065249 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 08:30:25.088017 1661 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:25.088160 1661 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:25.090279 1661 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b39b32b52bb04521af0861cae67296c2: Sending DeleteTablet for 3 replicas of tablet 529cf422760147a591610e3bd4f78da5
I20260808 08:30:25.090932 2081 tablet_service.cc:1514] Processing DeleteTablet for tablet 529cf422760147a591610e3bd4f78da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:25 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:39338
I20260808 08:30:25.090996 1946 tablet_service.cc:1514] Processing DeleteTablet for tablet 529cf422760147a591610e3bd4f78da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:25 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:41076
I20260808 08:30:25.091132 1803 tablet_service.cc:1514] Processing DeleteTablet for tablet 529cf422760147a591610e3bd4f78da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:25 UTC) from {username='oryx', principal='oryx/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:34770
I20260808 08:30:25.091219 2213 tablet_replica.cc:330] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a: stopping tablet replica
I20260808 08:30:25.091312 2214 tablet_replica.cc:330] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2: stopping tablet replica
I20260808 08:30:25.091377 2213 raft_consensus.cc:2229] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:25.091428 2214 raft_consensus.cc:2229] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:30:25.091503 2213 raft_consensus.cc:2258] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:25.091675 2212 tablet_replica.cc:330] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057: stopping tablet replica
I20260808 08:30:25.091689 2214 raft_consensus.cc:2258] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:25.091842 2212 raft_consensus.cc:2229] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:25.091981 2212 raft_consensus.cc:2258] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:25.092430 2214 ts_tablet_manager.cc:1905] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:25.092671 2213 ts_tablet_manager.cc:1905] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:25.094659 2213 ts_tablet_manager.cc:1918] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:30:25.094751 2213 log.cc:1196] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/529cf422760147a591610e3bd4f78da5
I20260808 08:30:25.095050 2213 ts_tablet_manager.cc:1939] T 529cf422760147a591610e3bd4f78da5 P d7d349861c22470c88976a9a94cee87a: Deleting consensus metadata
I20260808 08:30:25.095038 2214 ts_tablet_manager.cc:1918] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:30:25.095121 2214 log.cc:1196] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/529cf422760147a591610e3bd4f78da5
I20260808 08:30:25.095402 2214 ts_tablet_manager.cc:1939] T 529cf422760147a591610e3bd4f78da5 P a47e6bd1e8a44abe9fb80374922e24e2: Deleting consensus metadata
I20260808 08:30:25.095768 1649 catalog_manager.cc:4841] TS d7d349861c22470c88976a9a94cee87a (127.25.170.3:42237): tablet 529cf422760147a591610e3bd4f78da5 (table test-table [id=579ed3640f404e1e80166f22dc9bf1c7]) successfully deleted
I20260808 08:30:25.096122 1649 catalog_manager.cc:4841] TS a47e6bd1e8a44abe9fb80374922e24e2 (127.25.170.1:34327): tablet 529cf422760147a591610e3bd4f78da5 (table test-table [id=579ed3640f404e1e80166f22dc9bf1c7]) successfully deleted
I20260808 08:30:25.096341 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 1736
I20260808 08:30:25.099628 2212 ts_tablet_manager.cc:1905] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:25.101670 2212 ts_tablet_manager.cc:1918] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:30:25.101786 2212 log.cc:1196] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/529cf422760147a591610e3bd4f78da5
I20260808 08:30:25.102113 2212 ts_tablet_manager.cc:1939] T 529cf422760147a591610e3bd4f78da5 P 5f0165b37cfe4613919b6fd7ee102057: Deleting consensus metadata
I20260808 08:30:25.102737 1648 catalog_manager.cc:4841] TS 5f0165b37cfe4613919b6fd7ee102057 (127.25.170.2:33297): tablet 529cf422760147a591610e3bd4f78da5 (table test-table [id=579ed3640f404e1e80166f22dc9bf1c7]) successfully deleted
I20260808 08:30:25.106411 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 1881
I20260808 08:30:25.115371 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 2024
I20260808 08:30:25.123337 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 1629
2026-08-08T08:30:25Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3281 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:25 dist-test-slave-zkpd krb5kdc[2282](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:25 dist-test-slave-zkpd krb5kdc[2282](info): set up 2 sockets
Aug 08 08:30:25 dist-test-slave-zkpd krb5kdc[2282](info): commencing operation
krb5kdc: starting...
W20260808 08:30:26.194139 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:26 dist-test-slave-zkpd krb5kdc[2282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:30:26.316879 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:45175
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:40665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:45175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:26.427485 2295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:26.427726 2295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:26.427763 2295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:26.431746 2295 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:26.431799 2295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:26.431818 2295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:26.431834 2295 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:26.431874 2295 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:26.437119 2295 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:40665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:45175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:45175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:26.438158 2295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:26.439184 2295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:26.447554 2303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:26.447566 2300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:26.447600 2301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:26.447988 2295 server_base.cc:1034] running on GCE node
I20260808 08:30:26.448539 2295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:26.449535 2295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:26.450701 2295 hybrid_clock.cc:648] HybridClock initialized: now 1786177826450669 us; error 43 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T08:30:26Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1338 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:26 dist-test-slave-zkpd krb5kdc[2308](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:26 dist-test-slave-zkpd krb5kdc[2308](info): set up 2 sockets
Aug 08 08:30:26 dist-test-slave-zkpd krb5kdc[2308](info): commencing operation
krb5kdc: starting...
W20260808 08:30:27.534294 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:27 dist-test-slave-zkpd krb5kdc[2308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177827, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:30:27.658345 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:37701
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:37701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:27.768117 2321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:27.768356 2321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:27.768395 2321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:27.772249 2321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:27.772301 2321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:27.772322 2321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:27.772339 2321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:27.772356 2321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:27.777371 2321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:37701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:37701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:27.778283 2321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:27.779213 2321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:27.787400 2326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:27.787447 2327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:27.787402 2329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:27.787667 2321 server_base.cc:1034] running on GCE node
I20260808 08:30:27.788370 2321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:27.789342 2321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:27.790526 2321 hybrid_clock.cc:648] HybridClock initialized: now 1786177827790497 us; error 41 us; skew 500 ppm
Aug 08 08:30:27 dist-test-slave-zkpd krb5kdc[2308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177827, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:27.793289 2321 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:30:27.794166 2321 webserver.cc:460] Webserver started at http://127.25.170.62:46819/ using document root <none> and password file <none>
I20260808 08:30:27.794693 2321 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:27.794754 2321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:27.794976 2321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:27.796977 2321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "f022bd7d89904fcda6dd195db0de4878"
format_stamp: "Formatted at 2026-08-08 08:30:27 on dist-test-slave-zkpd"
server_key: "dda29249d95ea421f9c86ec662f4ad2b"
server_key_iv: "c5344035808c1ba133a4b3f98e11931b"
server_key_version: "encryptionkey@0"
I20260808 08:30:27.797547 2321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "f022bd7d89904fcda6dd195db0de4878"
format_stamp: "Formatted at 2026-08-08 08:30:27 on dist-test-slave-zkpd"
server_key: "dda29249d95ea421f9c86ec662f4ad2b"
server_key_iv: "c5344035808c1ba133a4b3f98e11931b"
server_key_version: "encryptionkey@0"
I20260808 08:30:27.801126 2321 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:30:27.803402 2336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:27.804672 2321 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:27.804796 2321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "f022bd7d89904fcda6dd195db0de4878"
format_stamp: "Formatted at 2026-08-08 08:30:27 on dist-test-slave-zkpd"
server_key: "dda29249d95ea421f9c86ec662f4ad2b"
server_key_iv: "c5344035808c1ba133a4b3f98e11931b"
server_key_version: "encryptionkey@0"
I20260808 08:30:27.804898 2321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:27.852195 2321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:27.855131 2321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:27.855345 2321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:27.862375 2321 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:37701
I20260808 08:30:27.862401 2388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:37701 every 8 connection(s)
I20260808 08:30:27.863277 2321 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:27.864535 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 2321
I20260808 08:30:27.864672 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:27.864953 26280 external_mini_cluster.cc:1428] Setting key f788b863f3748e0bd3e244ec48de8701
I20260808 08:30:27.866257 2389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:27.871760 2389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878: Bootstrap starting.
Aug 08 08:30:27 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177827, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:27.874250 2389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:27.874971 2389 log.cc:824] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:27.877153 2389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878: No bootstrap required, opened a new log
I20260808 08:30:27.878980 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:27.866343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37822 (local address 127.25.170.62:37701)
0808 08:30:27.866812 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:27.866829 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:27.866864 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:30:27.867504 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:27.867521 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:27.867834 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:27.868221 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:27.869013 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:27.869990 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:27.870916 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:27.871402 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:27.871577 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:27.874271 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:27.874276 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:27.874288 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:27.874346 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:27.876257 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:27.876731 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:27.876735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:27.876739 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:27.876846 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:27.877138 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:27.877140 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:27.877141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:27.877560 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:27.877709 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:27.877997 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 08:30:27.878285 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":185,"threads_started":1}
I20260808 08:30:27.880841 2389 raft_consensus.cc:348] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } }
I20260808 08:30:27.881073 2389 raft_consensus.cc:374] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:27.881135 2389 raft_consensus.cc:729] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f022bd7d89904fcda6dd195db0de4878, State: Initialized, Role: FOLLOWER
I20260808 08:30:27.881538 2389 consensus_queue.cc:260] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } }
I20260808 08:30:27.881676 2389 raft_consensus.cc:388] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:27.881763 2389 raft_consensus.cc:482] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:27.881878 2389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:27.882694 2389 raft_consensus.cc:504] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } }
I20260808 08:30:27.883038 2389 leader_election.cc:302] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f022bd7d89904fcda6dd195db0de4878; no voters:
I20260808 08:30:27.883320 2389 leader_election.cc:288] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:27.883458 2395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:27.883689 2395 raft_consensus.cc:686] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 1 LEADER]: Becoming Leader. State: Replica: f022bd7d89904fcda6dd195db0de4878, State: Running, Role: LEADER
I20260808 08:30:27.884059 2395 consensus_queue.cc:237] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } }
I20260808 08:30:27.884557 2389 sys_catalog.cc:564] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:27.886013 2396 sys_catalog.cc:455] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f022bd7d89904fcda6dd195db0de4878" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } } }
I20260808 08:30:27.886072 2397 sys_catalog.cc:455] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f022bd7d89904fcda6dd195db0de4878. Latest consensus state: current_term: 1 leader_uuid: "f022bd7d89904fcda6dd195db0de4878" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } } }
I20260808 08:30:27.886148 2396 sys_catalog.cc:458] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:27.886178 2397 sys_catalog.cc:458] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:27.886504 2404 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:27.889515 2404 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:27.895404 2404 catalog_manager.cc:1347] Generated new cluster ID: 179146c9e1b5452e972ad5305e495d0d
I20260808 08:30:27.895476 2404 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:27.937405 2404 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:27.938338 2404 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:27.943660 2404 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878: Generated new TSK 0
I20260808 08:30:27.944351 2404 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:30:27.975107 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:37701
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:28.091302 2417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:28.091539 2417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:28.091580 2417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:28.095598 2417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:28.095654 2417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:28.095759 2417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:28.100958 2417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:37701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:28.102212 2417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:28.103283 2417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:30:28.113366 2417 server_base.cc:1034] running on GCE node
W20260808 08:30:28.113317 2423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:28.113335 2422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:28.113317 2425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:28.113948 2417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:28.114500 2417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:28.115696 2417 hybrid_clock.cc:648] HybridClock initialized: now 1786177828115675 us; error 32 us; skew 500 ppm
Aug 08 08:30:28 dist-test-slave-zkpd krb5kdc[2308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:28.118547 2417 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:30:28.119400 2417 webserver.cc:460] Webserver started at http://127.25.170.1:34675/ using document root <none> and password file <none>
I20260808 08:30:28.120002 2417 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:28.120093 2417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:28.120323 2417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:28.122308 2417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "8a40e60faa714453ac2f751eb3d70fe3"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "1097663eb0a06ba2be49faaf29dfd5e9"
server_key_iv: "df3bbd36e5f75c45e8b35ffe6e3095e5"
server_key_version: "encryptionkey@0"
I20260808 08:30:28.122897 2417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "8a40e60faa714453ac2f751eb3d70fe3"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "1097663eb0a06ba2be49faaf29dfd5e9"
server_key_iv: "df3bbd36e5f75c45e8b35ffe6e3095e5"
server_key_version: "encryptionkey@0"
I20260808 08:30:28.126502 2417 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:30:28.128974 2432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:28.130270 2417 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:28.130415 2417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "8a40e60faa714453ac2f751eb3d70fe3"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "1097663eb0a06ba2be49faaf29dfd5e9"
server_key_iv: "df3bbd36e5f75c45e8b35ffe6e3095e5"
server_key_version: "encryptionkey@0"
I20260808 08:30:28.130527 2417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:28.151160 2417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:28.154573 2417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:28.154783 2417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:28.155380 2417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:28.156275 2417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:28.156342 2417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:28.156455 2417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:28.156503 2417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:28.165568 2417 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:35465
I20260808 08:30:28.165602 2548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:35465 every 8 connection(s)
I20260808 08:30:28.166472 2417 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:28.171693 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 2417
I20260808 08:30:28.171831 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:28.172128 26280 external_mini_cluster.cc:1428] Setting key 3abd4c149a8a41889463d08503f5ffc3
Aug 08 08:30:28 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:28.181453 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:28.168516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:53605 (local address 127.25.170.62:37701)
0808 08:30:28.168664 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:28.168668 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:28.169529 (+ 861us) server_negotiation.cc:407] Connection header received
0808 08:30:28.170927 (+ 1398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:28.170930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:28.170995 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:28.171098 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:28.172506 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.173163 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.174786 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.175030 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.175114 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:28.177814 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:28.177817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:28.177820 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:28.177850 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:28.179365 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:28.179880 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:28.179884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:28.179886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:28.179987 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:28.180362 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:28.180366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:28.180368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:28.180553 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:28.180679 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:28.181150 (+ 471us) server_negotiation.cc:299] Negotiation successful
0808 08:30:28.181280 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:30:28.182265 2551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:28.168887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:53605)
0808 08:30:28.169370 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:28.169413 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:28.170697 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:28.171282 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:28.171289 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:28.171685 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:28.172353 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:28.172369 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.173293 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.173297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:28.174631 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:28.174647 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.175185 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.175192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:28.175433 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:28.176182 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:28.176198 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:28.177634 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:28.179492 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:28.179497 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:28.179512 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:28.179770 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:28.180084 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:28.180087 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:28.180089 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:28.180232 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:28.180679 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:28.180686 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:28.180921 (+ 235us) client_negotiation.cc:769] Sending connection context
0808 08:30:28.181106 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 08:30:28.181431 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":139,"threads_started":1}
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
I20260808 08:30:28.183534 2549 heartbeater.cc:347] Connected to a master server at 127.25.170.62:37701
I20260808 08:30:28.183792 2549 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:28.184337 2549 heartbeater.cc:511] Master 127.25.170.62:37701 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:30:28.186057 2346 ts_manager.cc:194] Registered new tserver with Master: 8a40e60faa714453ac2f751eb3d70fe3 (127.25.170.1:35465)
I20260808 08:30:28.187541 2346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:53605
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:30:28.200852 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:37701
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:28.314188 2554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:28.314410 2554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:28.314453 2554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:28.318396 2554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:28.318455 2554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:28.318527 2554 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:28.323697 2554 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:37701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:28.324631 2554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:28.325532 2554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:28.334736 2562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:28.334800 2560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:28.334954 2554 server_base.cc:1034] running on GCE node
W20260808 08:30:28.334738 2559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:28.335405 2554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:28.336057 2554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:28.337232 2554 hybrid_clock.cc:648] HybridClock initialized: now 1786177828337198 us; error 44 us; skew 500 ppm
Aug 08 08:30:28 dist-test-slave-zkpd krb5kdc[2308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:28.339781 2554 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:30:28.340624 2554 webserver.cc:460] Webserver started at http://127.25.170.2:34847/ using document root <none> and password file <none>
I20260808 08:30:28.341135 2554 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:28.341217 2554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:28.341439 2554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:28.343323 2554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "b7f611080ef644dd9a7145169bfc5da0"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "8831914d47949b194faac5586f7024fd"
server_key_iv: "0c6e7f79c8398f6db2c19221877753d9"
server_key_version: "encryptionkey@0"
I20260808 08:30:28.343869 2554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "b7f611080ef644dd9a7145169bfc5da0"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "8831914d47949b194faac5586f7024fd"
server_key_iv: "0c6e7f79c8398f6db2c19221877753d9"
server_key_version: "encryptionkey@0"
I20260808 08:30:28.347437 2554 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:30:28.349726 2570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:28.350888 2554 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:30:28.351016 2554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "b7f611080ef644dd9a7145169bfc5da0"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "8831914d47949b194faac5586f7024fd"
server_key_iv: "0c6e7f79c8398f6db2c19221877753d9"
server_key_version: "encryptionkey@0"
I20260808 08:30:28.351119 2554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:28.370366 2554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:28.373064 2554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:28.373258 2554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:28.373836 2554 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:28.374614 2554 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:28.374682 2554 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:28.374750 2554 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:28.374790 2554 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:28.383649 2554 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:43273
I20260808 08:30:28.383694 2685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:43273 every 8 connection(s)
I20260808 08:30:28.384696 2554 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:28.387259 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 2554
I20260808 08:30:28.387419 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:28.387706 26280 external_mini_cluster.cc:1428] Setting key a21bbb676dbeb1336580ef72455a0ed7
Aug 08 08:30:28 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:30:28.399351 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:28.386615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:56301 (local address 127.25.170.62:37701)
0808 08:30:28.386749 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:28.386753 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:28.387719 (+ 966us) server_negotiation.cc:407] Connection header received
0808 08:30:28.389323 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:28.389327 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:28.389383 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:28.389458 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:28.390698 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.391394 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.392636 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.393050 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.393178 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:28.395643 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:28.395648 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:28.395651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:28.395683 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:28.397279 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:28.397769 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:28.397776 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:28.397779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:28.397877 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:28.398182 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:28.398188 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:28.398193 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:28.398457 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:28.398569 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:28.399056 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 08:30:28.399157 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 08:30:28.400154 2688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:28.387103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:56301)
0808 08:30:28.387564 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:28.387627 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:28.389123 (+ 1496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:28.389620 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:28.389627 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:28.390075 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:28.390556 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:28.390571 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.391547 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.391550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:28.392512 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:28.392522 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.393199 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.393202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:28.393349 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:28.393990 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:28.394013 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:28.395468 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:28.397413 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:28.397417 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:28.397428 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:28.397664 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:28.397969 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:28.397971 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:28.397972 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:28.398093 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:28.398570 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:28.398575 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:28.398848 (+ 273us) client_negotiation.cc:769] Sending connection context
0808 08:30:28.399001 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 08:30:28.399259 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":122,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
I20260808 08:30:28.401393 2686 heartbeater.cc:347] Connected to a master server at 127.25.170.62:37701
I20260808 08:30:28.401621 2686 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:28.402100 2686 heartbeater.cc:511] Master 127.25.170.62:37701 requested a full tablet report, sending...
I20260808 08:30:28.403117 2346 ts_manager.cc:194] Registered new tserver with Master: b7f611080ef644dd9a7145169bfc5da0 (127.25.170.2:43273)
I20260808 08:30:28.403677 2346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:56301
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:30:28.416251 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:37701
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:28.527971 2691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:28.528190 2691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:28.528230 2691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:28.532354 2691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:28.532405 2691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:28.532459 2691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:28.537637 2691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:37701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:28.538546 2691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:28.539449 2691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:28.548830 2696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:28.548820 2699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:28.548830 2697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:28.549206 2691 server_base.cc:1034] running on GCE node
I20260808 08:30:28.549546 2691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:28.550084 2691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:28.551237 2691 hybrid_clock.cc:648] HybridClock initialized: now 1786177828551208 us; error 48 us; skew 500 ppm
Aug 08 08:30:28 dist-test-slave-zkpd krb5kdc[2308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:28.554155 2691 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:30:28.554994 2691 webserver.cc:460] Webserver started at http://127.25.170.3:39873/ using document root <none> and password file <none>
I20260808 08:30:28.555534 2691 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:28.555598 2691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:28.555771 2691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:28.557924 2691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "15994fc5ac16493ca2e45fa44a3c2d7d"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "2891a1701c45d5842dd834b5928d9a50"
server_key_iv: "f2473731819898beeb9678a0b34342b5"
server_key_version: "encryptionkey@0"
I20260808 08:30:28.558475 2691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "15994fc5ac16493ca2e45fa44a3c2d7d"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "2891a1701c45d5842dd834b5928d9a50"
server_key_iv: "f2473731819898beeb9678a0b34342b5"
server_key_version: "encryptionkey@0"
I20260808 08:30:28.562309 2691 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:30:28.564772 2706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:28.566004 2691 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:28.566111 2691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "15994fc5ac16493ca2e45fa44a3c2d7d"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "2891a1701c45d5842dd834b5928d9a50"
server_key_iv: "f2473731819898beeb9678a0b34342b5"
server_key_version: "encryptionkey@0"
I20260808 08:30:28.566210 2691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:28.582818 2691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:28.586457 2691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:28.586606 2691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:28.587203 2691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:28.588018 2691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:28.588068 2691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:28.588109 2691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:28.588128 2691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:28.597465 2691 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:42545
I20260808 08:30:28.597512 2820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:42545 every 8 connection(s)
I20260808 08:30:28.598362 2691 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:28.602370 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 2691
I20260808 08:30:28.602527 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:28.602901 26280 external_mini_cluster.cc:1428] Setting key 02bb8b5a366fffae07f21e9fb8a7b07a
Aug 08 08:30:28 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:28.613199 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:28.600089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:54211 (local address 127.25.170.62:37701)
0808 08:30:28.600232 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:28.600236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:28.601048 (+ 812us) server_negotiation.cc:407] Connection header received
0808 08:30:28.602635 (+ 1587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:28.602639 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:28.602697 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:28.602771 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:28.604448 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.605250 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.606451 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.606656 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.606731 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:28.609871 (+ 3140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:28.609874 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:28.609876 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:28.609899 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:28.611130 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:28.611775 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:28.611778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:28.611779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:28.611867 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:28.612209 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:28.612212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:28.612213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:28.612380 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:28.612454 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:28.612958 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 08:30:28.613083 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:30:28.614002 2823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:28.600419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:54211)
0808 08:30:28.600882 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:28.600925 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:28.602340 (+ 1415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:28.603001 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:28.603010 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:28.603502 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:28.604271 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:28.604294 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.605381 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.605384 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:28.606339 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:28.606349 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:28.606791 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:28.606793 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:28.606941 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:28.607577 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:28.607594 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:28.609708 (+ 2114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:28.611240 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:28.611245 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:28.611257 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:28.611676 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:28.611997 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:28.612000 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:28.612002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:28.612139 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:28.612470 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:28.612475 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:28.612705 (+ 230us) client_negotiation.cc:769] Sending connection context
0808 08:30:28.612896 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 08:30:28.613174 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":110,"threads_started":1}
I20260808 08:30:28.615088 2821 heartbeater.cc:347] Connected to a master server at 127.25.170.62:37701
I20260808 08:30:28.615325 2821 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:28.615952 2821 heartbeater.cc:511] Master 127.25.170.62:37701 requested a full tablet report, sending...
I20260808 08:30:28.617012 2349 ts_manager.cc:194] Registered new tserver with Master: 15994fc5ac16493ca2e45fa44a3c2d7d (127.25.170.3:42545)
I20260808 08:30:28.617609 2349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:54211
I20260808 08:30:28.628888 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab.
Entry for principal oryx/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab.
WARNING: no policy specified for oryx/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab.
Entry for principal oryx/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab.
WARNING: no policy specified for oryx/127.25.170.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab.
Entry for principal oryx/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab.
I20260808 08:30:28.700031 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 2417
I20260808 08:30:28.707675 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 2554
I20260808 08:30:28.714211 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 2691
I20260808 08:30:28.723554 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 2321
I20260808 08:30:28.732339 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:37701
--webserver_interface=127.25.170.62
--webserver_port=46819
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:37701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:28.841665 2830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:28.841903 2830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:28.841970 2830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:28.845902 2830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:28.845950 2830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:28.845969 2830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:28.845985 2830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:28.846000 2830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:28.851105 2830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:37701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:37701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=46819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:28.852123 2830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:28.853082 2830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:28.861645 2836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:28.861753 2830 server_base.cc:1034] running on GCE node
W20260808 08:30:28.861625 2835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:28.861624 2838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:28.862617 2830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:28.863689 2830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:28.864877 2830 hybrid_clock.cc:648] HybridClock initialized: now 1786177828864853 us; error 36 us; skew 500 ppm
Aug 08 08:30:28 dist-test-slave-zkpd krb5kdc[2308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177828, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:28.867533 2830 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:30:28.868413 2830 webserver.cc:460] Webserver started at http://127.25.170.62:46819/ using document root <none> and password file <none>
I20260808 08:30:28.868955 2830 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:28.869066 2830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:28.872718 2830 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:28.874732 2845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:28.875861 2830 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:28.876048 2830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "f022bd7d89904fcda6dd195db0de4878"
format_stamp: "Formatted at 2026-08-08 08:30:27 on dist-test-slave-zkpd"
server_key: "dda29249d95ea421f9c86ec662f4ad2b"
server_key_iv: "c5344035808c1ba133a4b3f98e11931b"
server_key_version: "encryptionkey@0"
I20260808 08:30:28.876572 2830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:28.901687 2830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:28.904698 2830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:28.904899 2830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:28.912068 2900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:37701 every 8 connection(s)
I20260808 08:30:28.912104 2830 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:37701
I20260808 08:30:28.913091 2830 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:28.917508 2901 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:30:28.918437 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 2830
I20260808 08:30:28.918862 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:35465
--local_ip_for_outbound_sockets=127.25.170.1
--tserver_master_addrs=127.25.170.62:37701
--webserver_port=34675
--webserver_interface=127.25.170.1
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.170.1
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:30:28.919427 2901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878: Bootstrap starting.
I20260808 08:30:28.938601 2901 log.cc:824] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:28.945796 2901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:30:28.946228 2901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878: Bootstrap complete.
I20260808 08:30:28.950975 2901 raft_consensus.cc:348] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } }
I20260808 08:30:28.951421 2901 raft_consensus.cc:729] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f022bd7d89904fcda6dd195db0de4878, State: Initialized, Role: FOLLOWER
I20260808 08:30:28.952090 2901 consensus_queue.cc:260] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } }
I20260808 08:30:28.952262 2901 raft_consensus.cc:388] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:28.952337 2901 raft_consensus.cc:482] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:28.952471 2901 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:30:28.954559 2901 raft_consensus.cc:504] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } }
I20260808 08:30:28.954928 2901 leader_election.cc:302] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f022bd7d89904fcda6dd195db0de4878; no voters:
I20260808 08:30:28.955296 2901 leader_election.cc:288] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:30:28.955391 2905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:30:28.955600 2905 raft_consensus.cc:686] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [term 2 LEADER]: Becoming Leader. State: Replica: f022bd7d89904fcda6dd195db0de4878, State: Running, Role: LEADER
I20260808 08:30:28.955950 2905 consensus_queue.cc:237] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } }
I20260808 08:30:28.956636 2901 sys_catalog.cc:564] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:28.957386 2906 sys_catalog.cc:455] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f022bd7d89904fcda6dd195db0de4878" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } } }
I20260808 08:30:28.957513 2906 sys_catalog.cc:458] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:28.957813 2907 sys_catalog.cc:455] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f022bd7d89904fcda6dd195db0de4878. Latest consensus state: current_term: 2 leader_uuid: "f022bd7d89904fcda6dd195db0de4878" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f022bd7d89904fcda6dd195db0de4878" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 37701 } } }
I20260808 08:30:28.957959 2907 sys_catalog.cc:458] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:28.958251 2912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:28.961410 2912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:28.962281 2912 catalog_manager.cc:1259] Loaded cluster ID: 179146c9e1b5452e972ad5305e495d0d
I20260808 08:30:28.962340 2912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:28.964833 2912 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:28.965644 2912 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f022bd7d89904fcda6dd195db0de4878: Loaded TSK: 0
I20260808 08:30:28.966867 2912 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:30:29.036808 2903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:29.037045 2903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:29.037086 2903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:29.041050 2903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:29.041102 2903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:29.041184 2903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:29.046305 2903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.1.keytab
--principal=oryx/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:35465
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=34675
--tserver_master_addrs=127.25.170.62:37701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:29.047302 2903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:29.048360 2903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:29.059114 2927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:29.059345 2928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:29.059145 2930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:29.059598 2903 server_base.cc:1034] running on GCE node
I20260808 08:30:29.060199 2903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:29.060987 2903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:29.062206 2903 hybrid_clock.cc:648] HybridClock initialized: now 1786177829062169 us; error 44 us; skew 500 ppm
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177829, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:29.065860 2903 init.cc:377] Logged in from keytab as oryx/127.25.170.1@KRBTEST.COM (short username oryx)
I20260808 08:30:29.066707 2903 webserver.cc:460] Webserver started at http://127.25.170.1:34675/ using document root <none> and password file <none>
I20260808 08:30:29.067252 2903 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:29.067328 2903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:29.071334 2903 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:30:29.073596 2937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:29.074909 2903 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:30:29.075045 2903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "8a40e60faa714453ac2f751eb3d70fe3"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "1097663eb0a06ba2be49faaf29dfd5e9"
server_key_iv: "df3bbd36e5f75c45e8b35ffe6e3095e5"
server_key_version: "encryptionkey@0"
I20260808 08:30:29.075639 2903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:29.094429 2903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:29.097841 2903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:29.098047 2903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:29.098655 2903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:29.099566 2903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:29.099637 2903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:29.099711 2903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:29.099763 2903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:29.110859 2903 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:35465
I20260808 08:30:29.110960 3053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:35465 every 8 connection(s)
I20260808 08:30:29.111955 2903 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:29.116276 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 2903
I20260808 08:30:29.116757 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:43273
--local_ip_for_outbound_sockets=127.25.170.2
--tserver_master_addrs=127.25.170.62:37701
--webserver_port=34847
--webserver_interface=127.25.170.2
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.170.2
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:29.126885 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:29.114362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:48831)
0808 08:30:29.114897 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:29.114948 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:29.116280 (+ 1332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:29.117564 (+ 1284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:29.117571 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:29.118008 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:29.118567 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.118590 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.120397 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.120399 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.121253 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.121262 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.122405 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.122409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.122584 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.123310 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:29.123329 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:29.126152 (+ 2823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":122,"threads_started":1}
W20260808 08:30:29.127532 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:29.114258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:48831 (local address 127.25.170.62:37701)
0808 08:30:29.114755 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:29.114774 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:29.115067 (+ 293us) server_negotiation.cc:407] Connection header received
0808 08:30:29.116732 (+ 1665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:29.116743 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:29.117148 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:29.117482 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:29.118777 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.120256 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.121390 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.122215 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.122434 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.126464 (+ 4030us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:48831: BlockingRecv error: recv got EOF from 127.25.170.1:48831 (error 108)
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":120,"threads_started":1}
W20260808 08:30:29.127576 3054 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:37701 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.170.62:37701: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:29.133565 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:29.128038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:56637)
0808 08:30:29.128254 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:29.128277 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:29.128355 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:29.128614 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:29.128616 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:29.128744 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:29.128837 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.128841 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.129980 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.129982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.130514 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.130521 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.131078 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.131081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.131154 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.131654 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:29.131665 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:29.133473 (+ 1808us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":102}
W20260808 08:30:29.133766 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:29.128220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:56637 (local address 127.25.170.62:37701)
0808 08:30:29.128363 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:29.128370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:29.128389 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:30:29.128439 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:29.128443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:29.128500 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:29.128606 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:29.128954 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.129867 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.130620 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.130968 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.131081 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.133641 (+ 2560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:56637: BlockingRecv error: recv got EOF from 127.25.170.1:56637 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:29.139200 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:29.134263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:43245)
0808 08:30:29.134354 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:29.134370 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:29.134440 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:29.134665 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:29.134667 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:29.134785 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:29.134851 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.134855 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.135830 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.135832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.136382 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.136390 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.136954 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.136956 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.137010 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.137466 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:29.137477 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:29.139117 (+ 1640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 08:30:29.139377 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:29.134320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:43245 (local address 127.25.170.62:37701)
0808 08:30:29.134415 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:29.134419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:29.134432 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:29.134519 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:29.134522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:29.134563 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:29.134643 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:29.134952 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.135724 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.136491 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.136843 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.136947 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.139269 (+ 2322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:43245: BlockingRecv error: recv got EOF from 127.25.170.1:43245 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 08:30:29.139559 3054 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:30:29.236151 3058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:29.236387 3058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:29.236465 3058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:29.240337 3058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:29.240382 3058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:29.240491 3058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:29.245503 3058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.2.keytab
--principal=oryx/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:43273
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=34847
--tserver_master_addrs=127.25.170.62:37701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:29.246424 3058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:29.247414 3058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:29.256492 3063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:29.256628 3058 server_base.cc:1034] running on GCE node
W20260808 08:30:29.256507 3066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:29.256529 3064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:29.257162 3058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:29.257841 3058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:29.259003 3058 hybrid_clock.cc:648] HybridClock initialized: now 1786177829258974 us; error 39 us; skew 500 ppm
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177829, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:29.261780 3058 init.cc:377] Logged in from keytab as oryx/127.25.170.2@KRBTEST.COM (short username oryx)
I20260808 08:30:29.262579 3058 webserver.cc:460] Webserver started at http://127.25.170.2:34847/ using document root <none> and password file <none>
I20260808 08:30:29.263118 3058 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:29.263231 3058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:29.267038 3058 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:29.269376 3073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:29.270707 3058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:30:29.270886 3058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "b7f611080ef644dd9a7145169bfc5da0"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "8831914d47949b194faac5586f7024fd"
server_key_iv: "0c6e7f79c8398f6db2c19221877753d9"
server_key_version: "encryptionkey@0"
I20260808 08:30:29.271471 3058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:29.298007 3058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:29.301183 3058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:29.301407 3058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:29.302026 3058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:29.302876 3058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:29.302947 3058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:29.303022 3058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:29.303066 3058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:29.312127 3058 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:43273
I20260808 08:30:29.312170 3187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:43273 every 8 connection(s)
I20260808 08:30:29.313231 3058 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:29.314429 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 3058
I20260808 08:30:29.314968 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:42545
--local_ip_for_outbound_sockets=127.25.170.3
--tserver_master_addrs=127.25.170.62:37701
--webserver_port=39873
--webserver_interface=127.25.170.3
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.170.3
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:30:29.328449 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:29.315143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:46011 (local address 127.25.170.62:37701)
0808 08:30:29.315313 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:29.315319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:29.316345 (+ 1026us) server_negotiation.cc:407] Connection header received
0808 08:30:29.317704 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:29.317708 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:29.317790 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:29.317892 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:29.320014 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.320967 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.322947 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.323386 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.323499 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.328319 (+ 4820us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:46011: BlockingRecv error: recv got EOF from 127.25.170.2:46011 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:30:29.329334 3190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:29.315632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:46011)
0808 08:30:29.316171 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:29.316213 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:29.317485 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:29.318075 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:29.318081 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:29.318429 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:29.319774 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.319819 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.321145 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.321150 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.322788 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.322803 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.323606 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.323615 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.323859 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.324594 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:29.324620 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:29.328185 (+ 3565us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":169,"threads_started":1}
W20260808 08:30:29.329856 3188 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:37701 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.170.62:37701: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:29.337110 3190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:29.330376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:57601)
0808 08:30:29.330488 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:29.330504 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:29.330587 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:29.330931 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:29.330935 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:29.331106 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:29.331223 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.331231 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.332365 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.332371 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.333330 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.333343 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.334057 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.334061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.334166 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.334707 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:29.334725 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:29.336955 (+ 2230us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 08:30:29.337436 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:29.330455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:57601 (local address 127.25.170.62:37701)
0808 08:30:29.330571 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:29.330575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:29.330588 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:29.330674 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:29.330676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:29.330718 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:29.330798 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:29.331364 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.332226 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.333461 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.333829 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.333927 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.337124 (+ 3197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:57601: BlockingRecv error: recv got EOF from 127.25.170.2:57601 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:30:29.345631 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:29.337969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:47817 (local address 127.25.170.62:37701)
0808 08:30:29.338079 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:29.338083 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:29.338193 (+ 110us) server_negotiation.cc:407] Connection header received
0808 08:30:29.338338 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:29.338341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:29.338384 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:29.338464 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:29.338966 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.339750 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.340714 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.341068 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.341170 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.345517 (+ 4347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:47817: BlockingRecv error: recv got EOF from 127.25.170.2:47817 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 08:30:29.346114 3190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:29.337911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:47817)
0808 08:30:29.338105 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:29.338124 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:29.338229 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:29.338515 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:29.338521 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:29.338704 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:29.338837 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.338848 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.339853 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.339857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.340602 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.340614 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.341290 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.341295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.341401 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.341890 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:29.341909 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:29.346001 (+ 4092us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105}
W20260808 08:30:29.346668 3188 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:30:29.445554 3191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:29.445842 3191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:29.445942 3191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:29.449887 3191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:29.449960 3191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:29.450042 3191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:29.455346 3191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/krb5kdc/oryx_127.25.170.3.keytab
--principal=oryx/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:42545
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=39873
--tserver_master_addrs=127.25.170.62:37701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:29.456396 3191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:29.457391 3191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:29.468762 3196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:29.468816 3191 server_base.cc:1034] running on GCE node
W20260808 08:30:29.469059 3197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:29.469244 3199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:29.469769 3191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:29.470438 3191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:29.471624 3191 hybrid_clock.cc:648] HybridClock initialized: now 1786177829471594 us; error 45 us; skew 500 ppm
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177829, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:29.474346 3191 init.cc:377] Logged in from keytab as oryx/127.25.170.3@KRBTEST.COM (short username oryx)
I20260808 08:30:29.475332 3191 webserver.cc:460] Webserver started at http://127.25.170.3:39873/ using document root <none> and password file <none>
I20260808 08:30:29.476011 3191 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:29.476116 3191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:29.480355 3191 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:30:29.482369 3206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:29.483585 3191 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:29.483716 3191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "15994fc5ac16493ca2e45fa44a3c2d7d"
format_stamp: "Formatted at 2026-08-08 08:30:28 on dist-test-slave-zkpd"
server_key: "2891a1701c45d5842dd834b5928d9a50"
server_key_iv: "f2473731819898beeb9678a0b34342b5"
server_key_version: "encryptionkey@0"
I20260808 08:30:29.484342 3191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:29.543433 3191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:29.546428 3191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:29.546644 3191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:29.547271 3191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:29.548157 3191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:29.548228 3191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:29.548301 3191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:29.548347 3191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:29.557598 3191 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:42545
I20260808 08:30:29.557631 3321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:42545 every 8 connection(s)
I20260808 08:30:29.558739 3191 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:29.563525 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 3191
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:30:29.570559 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:29.560688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:48531 (local address 127.25.170.62:37701)
0808 08:30:29.560823 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:29.560827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:29.561665 (+ 838us) server_negotiation.cc:407] Connection header received
0808 08:30:29.562918 (+ 1253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:29.562921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:29.562965 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:29.563037 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:29.564412 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.565052 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.566211 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.566426 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.566533 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.570421 (+ 3888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:48531: BlockingRecv error: recv got EOF from 127.25.170.3:48531 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:30:29.571357 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:29.561070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:48531)
0808 08:30:29.561520 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:29.561560 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:29.562727 (+ 1167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:29.563204 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:29.563210 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:29.563548 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:29.564239 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.564276 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.565187 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.565190 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.566083 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.566093 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.566574 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.566578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.566756 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.567396 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:29.567415 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:29.570318 (+ 2903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":119,"threads_started":1}
W20260808 08:30:29.571847 3322 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:37701 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.170.62:37701: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
I20260808 08:30:29.574170 3326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:29.564613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37836 (local address 127.25.170.62:37701)
0808 08:30:29.564898 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:29.564902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:29.564912 (+ 10us) server_negotiation.cc:407] Connection header received
0808 08:30:29.564942 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:29.564944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:29.564977 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:29.565075 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:29.565797 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.566308 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.567242 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.567606 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.567712 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.569531 (+ 1819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:29.569540 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:29.569559 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:29.569592 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:29.571717 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:29.572269 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:29.572276 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:29.572282 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:29.572462 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:29.572823 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:29.572825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:29.572826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:29.573313 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:29.573518 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:29.573830 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 08:30:29.574056 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":195,"thread_start_us":91,"threads_started":1}
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:29.577637 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:29.572331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:50963)
0808 08:30:29.572417 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:29.572432 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:29.572506 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:29.572756 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:29.572762 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:29.572916 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:29.573005 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.573010 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.573777 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.573782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.574587 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.574597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.575168 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.575172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.575268 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.575726 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:29.575741 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:29.577556 (+ 1815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 08:30:29.577767 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:29.572394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:50963 (local address 127.25.170.62:37701)
0808 08:30:29.572508 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:29.572513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:29.572526 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:29.572617 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:29.572619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:29.572651 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:29.572706 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:29.573120 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.573653 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.574708 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.575039 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.575147 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.577665 (+ 2518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:50963: BlockingRecv error: recv got EOF from 127.25.170.3:50963 (error 108)
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":47}
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:29 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:29.582902 3324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:29.578289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:40739)
0808 08:30:29.578410 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:29.578427 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:29.578504 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:29.578730 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:29.578733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:29.578887 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:29.578955 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.578960 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.579756 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.579761 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.580348 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:29.580357 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.580844 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.580848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:29.580925 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.581304 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:29.581315 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:29.582823 (+ 1508us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 08:30:29.583024 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:29.578339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:40739 (local address 127.25.170.62:37701)
0808 08:30:29.578489 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:29.578493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:29.578506 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:29.578590 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:29.578593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:29.578633 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:29.578715 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:29.579074 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.579652 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.580469 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:29.580730 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:29.580844 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:29.582930 (+ 2086us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:40739: BlockingRecv error: recv got EOF from 127.25.170.3:40739 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 08:30:29.583187 3322 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 08:30:30 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:30 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:30.145437 3327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:30.140160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:47773)
0808 08:30:30.140437 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:30.140451 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:30.140539 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:30.140770 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:30.140773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:30.140949 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:30.141071 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:30.141076 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.141827 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.141830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:30.142395 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:30.142402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.142816 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.142818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:30.142889 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:30.143472 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:30.143484 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:30.145322 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":93,"threads_started":1}
W20260808 08:30:30.145594 3328 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:30.140269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:47773 (local address 127.25.170.62:37701)
0808 08:30:30.140537 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:30.140540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:30.140553 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:30.140608 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:30.140611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:30.140653 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:30.140739 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:30.141178 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.141729 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.142495 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.142714 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.142797 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:30.145462 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:47773: BlockingRecv error: recv got EOF from 127.25.170.1:47773 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":122,"threads_started":1}
Aug 08 08:30:30 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:30 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:30.352543 3329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:30.347365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:41259)
0808 08:30:30.347638 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:30.347652 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:30.347749 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:30.347999 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:30.348002 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:30.348182 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:30.348285 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:30.348289 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.349009 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.349012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:30.349572 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:30.349579 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.349992 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.349994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:30.350058 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:30.350623 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:30.350635 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:30.352424 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":106,"threads_started":1}
W20260808 08:30:30.352680 3328 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:30.347421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:41259 (local address 127.25.170.62:37701)
0808 08:30:30.347571 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:30.347576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:30.347712 (+ 136us) server_negotiation.cc:407] Connection header received
0808 08:30:30.347826 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:30.347828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:30.347873 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:30.347959 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:30.348388 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.348912 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.349674 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.349894 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.349973 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:30.352560 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:41259: BlockingRecv error: recv got EOF from 127.25.170.2:41259 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 08:30:30 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:30 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:30.589673 3330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:30.583713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:50523)
0808 08:30:30.584040 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:30.584053 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:30.584138 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:30.584399 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:30.584419 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:30.584595 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:30.584710 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:30.584715 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.585721 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.585725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:30.586419 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:30.586431 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.587000 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.587005 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:30.587149 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:30.587656 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:30.587667 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:30.589563 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":119,"threads_started":1}
W20260808 08:30:30.589825 3328 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:30.583936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:50523 (local address 127.25.170.62:37701)
0808 08:30:30.584090 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:30.584094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:30.584108 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:30.584225 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:30.584228 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:30.584277 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:30.584359 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:30.584840 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.585623 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.586537 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:30.586861 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:30.586957 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:30.589691 (+ 2734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:50523: BlockingRecv error: recv got EOF from 127.25.170.3:50523 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 08:30:31 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:31 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:31.152420 3331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:31.146375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:48829)
0808 08:30:31.146681 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:31.146695 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:31.146808 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:31.147178 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:31.147181 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:31.147373 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:31.147486 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:31.147492 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.148587 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.148593 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:31.149280 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:31.149293 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.149727 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.149730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:31.149806 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:31.150316 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:31.150329 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:31.152281 (+ 1952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":91,"threads_started":1}
W20260808 08:30:31.152606 3332 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:31.146488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:48829 (local address 127.25.170.62:37701)
0808 08:30:31.146737 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:31.146741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:31.146756 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:30:31.146962 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:31.146965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:31.147018 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:31.147108 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:31.147641 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.148458 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.149400 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.149622 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.149705 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:31.152424 (+ 2719us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:48829: BlockingRecv error: recv got EOF from 127.25.170.1:48829 (error 108)
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":66,"threads_started":1}
Aug 08 08:30:31 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:31 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:31.359242 3333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:31.353422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:50417)
0808 08:30:31.353775 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:31.353796 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:31.353956 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:31.354234 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:31.354237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:31.354464 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:31.354565 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:31.354571 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.355346 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.355353 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:31.355984 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:31.355993 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.356512 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.356516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:31.356607 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:31.357086 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:31.357097 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:31.359059 (+ 1962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":106,"threads_started":1}
W20260808 08:30:31.359301 3332 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:31.353552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:50417 (local address 127.25.170.62:37701)
0808 08:30:31.353733 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:31.353738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:31.353890 (+ 152us) server_negotiation.cc:407] Connection header received
0808 08:30:31.354076 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:31.354078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:31.354124 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:31.354209 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:31.354693 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.355225 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.356123 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.356357 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.356489 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:31.359187 (+ 2698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:50417: BlockingRecv error: recv got EOF from 127.25.170.2:50417 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 08:30:31 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:31 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:31.600980 3334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:31.590411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:46145)
0808 08:30:31.590742 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:31.590759 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:31.590892 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:31.591174 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:31.591177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:31.591391 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:31.591491 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:31.591496 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.592334 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.592338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:31.592907 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:31.592915 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.593395 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.593398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:31.593487 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:31.598864 (+ 5377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:31.598876 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:31.600809 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":135,"threads_started":1}
W20260808 08:30:31.601045 3332 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:31.590587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:46145 (local address 127.25.170.62:37701)
0808 08:30:31.590735 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:31.590740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:31.590842 (+ 102us) server_negotiation.cc:407] Connection header received
0808 08:30:31.590997 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:31.591001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:31.591058 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:31.591143 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:31.591611 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.592209 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.593032 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:31.593266 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:31.593380 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:31.600940 (+ 7560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:46145: BlockingRecv error: recv got EOF from 127.25.170.3:46145 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 08:30:32 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:32 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:32.158815 3335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:32.153209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:53913)
0808 08:30:32.153485 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:32.153498 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:32.153597 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:32.153863 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:32.153865 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:32.154047 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:32.154146 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:32.154151 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.154876 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.154879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:32.155454 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:32.155461 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.156010 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.156014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:32.156112 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:32.156729 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:32.156751 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:32.158631 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":96,"threads_started":1}
W20260808 08:30:32.158975 3336 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:32.153268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:53913 (local address 127.25.170.62:37701)
0808 08:30:32.153517 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:32.153521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:32.153552 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:30:32.153687 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:32.153689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:32.153748 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:32.153830 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:32.154248 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.154783 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.155576 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.155862 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.156003 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:32.158808 (+ 2805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:53913: BlockingRecv error: recv got EOF from 127.25.170.1:53913 (error 108)
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":73,"threads_started":1}
Aug 08 08:30:32 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:32 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:32.366060 3337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:32.360097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:58651)
0808 08:30:32.360394 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:32.360408 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:32.360506 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:32.360743 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:32.360745 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:32.360934 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:32.361036 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:32.361041 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.362050 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.362080 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:32.362793 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:32.362803 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.363218 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.363220 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:32.363286 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:32.363867 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:32.363879 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:32.365884 (+ 2005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":109,"threads_started":1}
W20260808 08:30:32.366098 3336 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:32.360143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:58651 (local address 127.25.170.62:37701)
0808 08:30:32.360306 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:32.360310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:32.360476 (+ 166us) server_negotiation.cc:407] Connection header received
0808 08:30:32.360584 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:32.360587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:32.360633 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:32.360703 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:32.361153 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.361953 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.362905 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.363120 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.363200 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:32.366001 (+ 2801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:58651: BlockingRecv error: recv got EOF from 127.25.170.2:58651 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 08 08:30:32 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:32 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:32.607854 3338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:32.601833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:50823)
0808 08:30:32.602206 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:32.602231 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:32.602396 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:32.602723 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:32.602726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:32.602959 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:32.603065 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:32.603071 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.603954 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.603958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:32.604610 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:32.604618 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.605186 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.605190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:32.605295 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:32.605831 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:32.605844 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:32.607712 (+ 1868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":87,"threads_started":1}
W20260808 08:30:32.608031 3336 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:32.601955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:50823 (local address 127.25.170.62:37701)
0808 08:30:32.602153 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:32.602159 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:32.602320 (+ 161us) server_negotiation.cc:407] Connection header received
0808 08:30:32.602533 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:32.602536 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:32.602588 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:32.602685 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:32.603211 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.603791 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.604801 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:32.605056 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:32.605178 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:32.607849 (+ 2671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:50823: BlockingRecv error: recv got EOF from 127.25.170.3:50823 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 08 08:30:33 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:33 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:33.165436 3339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:33.159534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:51299)
0808 08:30:33.159824 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:33.159840 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:33.159987 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:33.160241 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:33.160243 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:33.160435 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:33.160536 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:33.160541 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.161431 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.161435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:33.162278 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:33.162288 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.162761 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.162764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:33.162839 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:33.163338 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:33.163351 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:33.165310 (+ 1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":72,"threads_started":1}
W20260808 08:30:33.165596 3340 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:33.159647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:51299 (local address 127.25.170.62:37701)
0808 08:30:33.159932 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:33.159936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:33.159949 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:33.160078 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:33.160080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:33.160125 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:33.160201 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:33.160635 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.161266 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.162388 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.162612 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.162705 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:33.165454 (+ 2749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:51299: BlockingRecv error: recv got EOF from 127.25.170.1:51299 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":87,"threads_started":1}
Aug 08 08:30:33 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:33 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:33.372485 3341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:33.366899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:41649)
0808 08:30:33.367166 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:33.367183 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:33.367311 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:33.367628 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:33.367630 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:33.367824 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:33.368011 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:33.368022 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.368853 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.368856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:33.369413 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:33.369422 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.369822 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.369825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:33.369887 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:33.370379 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:33.370390 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:33.372315 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":81,"threads_started":1}
W20260808 08:30:33.372521 3340 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:33.366961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:41649 (local address 127.25.170.62:37701)
0808 08:30:33.367107 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:33.367112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:33.367266 (+ 154us) server_negotiation.cc:407] Connection header received
0808 08:30:33.367434 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:33.367437 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:33.367494 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:33.367583 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:33.368144 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.368738 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.369516 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.369723 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.369796 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:33.372422 (+ 2626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:41649: BlockingRecv error: recv got EOF from 127.25.170.2:41649 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 08:30:33 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:33 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:33.614289 3342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:33.608805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:47369)
0808 08:30:33.609114 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:33.609128 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:33.609255 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:33.609534 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:33.609537 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:33.609795 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:33.609920 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:33.609927 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.610832 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.610835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:33.611387 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:33.611395 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.611799 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.611802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:33.611863 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:33.612385 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:33.612397 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:33.614173 (+ 1776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":89,"threads_started":1}
W20260808 08:30:33.614485 3340 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:33.608903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:47369 (local address 127.25.170.62:37701)
0808 08:30:33.609100 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:33.609105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:33.609213 (+ 108us) server_negotiation.cc:407] Connection header received
0808 08:30:33.609355 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:33.609357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:33.609403 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:33.609478 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:33.610043 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.610713 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.611489 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:33.611693 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:33.611790 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:33.614321 (+ 2531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:47369: BlockingRecv error: recv got EOF from 127.25.170.3:47369 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 08:30:34 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:34 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:34.172027 3343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:34.166247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:57817)
0808 08:30:34.166576 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:34.166589 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:34.166680 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:34.166912 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:34.166914 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:34.167101 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:34.167199 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:34.167204 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.168020 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.168031 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:34.168612 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:34.168620 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.169105 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.169109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:34.169196 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:34.169775 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:34.169788 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:34.171828 (+ 2040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":100,"threads_started":1}
W20260808 08:30:34.172113 3344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:34.166446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:57817 (local address 127.25.170.62:37701)
0808 08:30:34.166701 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:34.166704 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:34.166716 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:30:34.166752 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:34.166754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:34.166796 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:34.166873 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:34.167325 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.167867 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.168738 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.168977 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.169097 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:34.171984 (+ 2887us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:57817: BlockingRecv error: recv got EOF from 127.25.170.1:57817 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":107,"threads_started":1}
Aug 08 08:30:34 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:34 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:34.378949 3345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:34.373254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:53289)
0808 08:30:34.373544 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:34.373557 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:34.373653 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:34.373908 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:34.373909 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:34.374097 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:34.374199 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:34.374204 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.374986 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.374989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:34.375550 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:34.375559 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.376138 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.376141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:34.376209 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:34.376695 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:34.376707 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:34.378774 (+ 2067us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":98,"threads_started":1}
W20260808 08:30:34.378994 3344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:34.373413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:53289 (local address 127.25.170.62:37701)
0808 08:30:34.373554 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:34.373557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:34.373627 (+ 70us) server_negotiation.cc:407] Connection header received
0808 08:30:34.373739 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:34.373742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:34.373785 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:34.373868 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:34.374301 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.374885 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.375690 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.376022 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.376116 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:34.378893 (+ 2777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:53289: BlockingRecv error: recv got EOF from 127.25.170.2:53289 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 08:30:34 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:34 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:34.621181 3346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:34.615060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:59037)
0808 08:30:34.615417 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:34.615434 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:34.615545 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:34.615847 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:34.615850 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:34.616077 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:34.616196 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:34.616201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.617023 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.617028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:34.617634 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:34.617642 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.618238 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.618241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:34.618376 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:34.619035 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:34.619048 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:34.621058 (+ 2010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":109,"threads_started":1}
W20260808 08:30:34.621395 3344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:34.615251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:59037 (local address 127.25.170.62:37701)
0808 08:30:34.615416 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:34.615422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:34.615492 (+ 70us) server_negotiation.cc:407] Connection header received
0808 08:30:34.615654 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:34.615658 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:34.615713 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:34.615798 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:34.616328 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.616903 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.617759 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:34.618096 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:34.618215 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:34.621263 (+ 3048us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:59037: BlockingRecv error: recv got EOF from 127.25.170.3:59037 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 08 08:30:35 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:35 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:35.178634 3347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:35.172956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:48127)
0808 08:30:35.173259 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:35.173276 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:35.173402 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:35.173724 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:35.173727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:35.173947 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:35.174049 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:35.174055 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.174844 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.174850 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:35.175516 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:35.175525 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.176062 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.176066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:35.176147 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:35.176635 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:35.176646 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:35.178518 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":88,"threads_started":1}
W20260808 08:30:35.178843 3348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:35.173005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:48127 (local address 127.25.170.62:37701)
0808 08:30:35.173349 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:35.173354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:35.173368 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:35.173530 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:35.173533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:35.173587 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:35.173684 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:35.174173 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.174719 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.175644 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.175935 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.176075 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:35.178651 (+ 2576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:48127: BlockingRecv error: recv got EOF from 127.25.170.1:48127 (error 108)
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":153,"threads_started":1}
Aug 08 08:30:35 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:35 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:35.385659 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:35.379775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:55991)
0808 08:30:35.380280 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:35.380304 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:35.380443 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:35.380806 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:35.380809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:35.381084 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:35.381221 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:35.381232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.381993 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.381995 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:35.382546 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:35.382553 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.383038 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.383041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:35.383100 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:35.383658 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:35.383673 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:35.385548 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":107,"threads_started":1}
W20260808 08:30:35.385869 3348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:35.379844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:55991 (local address 127.25.170.62:37701)
0808 08:30:35.379999 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:35.380004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:35.380393 (+ 389us) server_negotiation.cc:407] Connection header received
0808 08:30:35.380547 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:35.380550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:35.380615 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:35.380753 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:35.381344 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.381888 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.382681 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.382932 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.383026 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:35.385683 (+ 2657us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:55991: BlockingRecv error: recv got EOF from 127.25.170.2:55991 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 08:30:35 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:35 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:35.627351 3350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:35.622022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:54251)
0808 08:30:35.622317 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:35.622330 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:35.622428 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:35.622640 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:35.622642 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:35.622825 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:35.622922 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:35.622926 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.623635 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.623638 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:35.624249 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:35.624257 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.624697 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.624700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:35.624761 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:35.625331 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:35.625343 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:35.627231 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":103,"threads_started":1}
W20260808 08:30:35.627478 3348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:35.622084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:54251 (local address 127.25.170.62:37701)
0808 08:30:35.622215 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:35.622220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:35.622400 (+ 180us) server_negotiation.cc:407] Connection header received
0808 08:30:35.622494 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:35.622496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:35.622542 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:35.622604 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:35.623017 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.623544 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.624358 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:35.624599 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:35.624676 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:35.627362 (+ 2686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:54251: BlockingRecv error: recv got EOF from 127.25.170.3:54251 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 08:30:36 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:36 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:36.185616 3351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:36.179400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:51381)
0808 08:30:36.179741 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:36.179780 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:36.179913 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:36.180216 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:36.180218 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:36.180416 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:36.180513 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:36.180518 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.181577 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.181580 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:36.182320 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:36.182331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.182810 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.182815 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:36.182902 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:36.183481 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:36.183493 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:36.185441 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":96,"threads_started":1}
W20260808 08:30:36.185688 3352 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:36.179523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:51381 (local address 127.25.170.62:37701)
0808 08:30:36.179825 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:36.179829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:36.179843 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:36.180038 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:36.180043 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:36.180094 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:36.180178 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:36.180652 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.181391 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.182438 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.182682 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.182794 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:36.185563 (+ 2769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:51381: BlockingRecv error: recv got EOF from 127.25.170.1:51381 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":85,"threads_started":1}
Aug 08 08:30:36 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:36 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:36.392230 3353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:36.386484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:39439)
0808 08:30:36.386909 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:36.386923 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:36.387050 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:36.387364 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:36.387367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:36.387653 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:36.387758 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:36.387766 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.388614 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.388620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:36.389202 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:36.389211 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.389646 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.389648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:36.389713 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:36.390288 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:36.390301 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:36.392115 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":86,"threads_started":1}
W20260808 08:30:36.392371 3352 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:36.386553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:39439 (local address 127.25.170.62:37701)
0808 08:30:36.386700 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:36.386707 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:36.387004 (+ 297us) server_negotiation.cc:407] Connection header received
0808 08:30:36.387164 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:36.387167 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:36.387225 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:36.387327 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:36.387878 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.388466 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.389325 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.389540 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.389623 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:36.392241 (+ 2618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:39439: BlockingRecv error: recv got EOF from 127.25.170.2:39439 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 08:30:36 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:36 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:36.638944 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:36.628307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:38121)
0808 08:30:36.628692 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:36.628705 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:36.628807 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:36.629051 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:36.629053 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:36.629247 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:36.629371 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:36.629377 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.630088 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.630090 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:36.630648 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:36.630655 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.631059 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.631062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:36.631124 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:36.636656 (+ 5532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:36.636672 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:36.638830 (+ 2158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":129,"threads_started":1}
W20260808 08:30:36.639078 3352 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:36.628388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:38121 (local address 127.25.170.62:37701)
0808 08:30:36.628526 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:36.628530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:36.628777 (+ 247us) server_negotiation.cc:407] Connection header received
0808 08:30:36.628890 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:36.628892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:36.628940 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:36.629008 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:36.629477 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.629996 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.630748 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:36.630962 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:36.631037 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:36.638964 (+ 7927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:38121: BlockingRecv error: recv got EOF from 127.25.170.3:38121 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 08:30:37 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:37 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:37.192030 3355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:37.186389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:41617)
0808 08:30:37.186672 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:37.186688 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:37.186782 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:37.187031 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:37.187033 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:37.187220 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:37.187334 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:37.187340 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.188218 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.188221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:37.188911 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:37.188921 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.189377 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.189379 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:37.189442 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:37.189984 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:37.189995 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:37.191835 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":103,"threads_started":1}
W20260808 08:30:37.192107 3356 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:37.186495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:41617 (local address 127.25.170.62:37701)
0808 08:30:37.186725 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:37.186728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:37.186741 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:30:37.186869 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:37.186871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:37.186916 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:37.186994 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:37.187476 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.188119 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.189028 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.189245 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.189330 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:37.191984 (+ 2654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:41617: BlockingRecv error: recv got EOF from 127.25.170.1:41617 (error 108)
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":86,"threads_started":1}
Aug 08 08:30:37 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:37 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:37.398396 3357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:37.392992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:44823)
0808 08:30:37.393284 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:37.393297 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:37.393398 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:37.393630 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:37.393632 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:37.393845 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:37.393950 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:37.393955 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.394817 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.394820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:37.395378 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:37.395385 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.395792 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.395795 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:37.395855 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:37.396447 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:37.396459 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:37.398274 (+ 1815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":95,"threads_started":1}
W20260808 08:30:37.398522 3356 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:37.393109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:44823 (local address 127.25.170.62:37701)
0808 08:30:37.393257 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:37.393260 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:37.393368 (+ 108us) server_negotiation.cc:407] Connection header received
0808 08:30:37.393478 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:37.393480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:37.393525 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:37.393593 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:37.394048 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.394709 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.395475 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.395678 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.395753 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:37.398409 (+ 2656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:44823: BlockingRecv error: recv got EOF from 127.25.170.2:44823 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 08:30:37 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:37 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:37.645591 3358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:37.639881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:40575)
0808 08:30:37.640189 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:37.640204 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:37.640356 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:37.640652 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:37.640655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:37.640878 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:37.641019 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:37.641030 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.641789 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.641795 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:37.642418 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:37.642428 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.642924 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.642928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:37.643016 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:37.643500 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:37.643512 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:37.645420 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":87,"threads_started":1}
W20260808 08:30:37.645651 3356 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:37.639971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:40575 (local address 127.25.170.62:37701)
0808 08:30:37.640142 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:37.640147 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:37.640291 (+ 144us) server_negotiation.cc:407] Connection header received
0808 08:30:37.640483 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:37.640486 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:37.640544 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:37.640627 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:37.641126 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.641673 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.642542 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:37.642800 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:37.642918 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:37.645542 (+ 2624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:40575: BlockingRecv error: recv got EOF from 127.25.170.3:40575 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 08 08:30:38 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:38 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:38.198307 3359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:38.192944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:47433)
0808 08:30:38.193222 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:38.193244 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:38.193341 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:38.193595 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:38.193596 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:38.193793 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:38.193895 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:38.193900 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.194622 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.194624 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:38.195167 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:38.195174 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.195655 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.195658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:38.195721 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:38.196215 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:38.196227 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:38.198192 (+ 1965us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":103,"threads_started":1}
W20260808 08:30:38.198519 3360 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:38.193024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:47433 (local address 127.25.170.62:37701)
0808 08:30:38.193265 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:38.193269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:38.193284 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:30:38.193430 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:38.193433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:38.193479 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:38.193557 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:38.193998 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.194529 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.195299 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.195547 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.195638 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:38.198336 (+ 2698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:47433: BlockingRecv error: recv got EOF from 127.25.170.1:47433 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":85,"threads_started":1}
Aug 08 08:30:38 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:38 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:38.404757 3361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:38.399240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:49705)
0808 08:30:38.399517 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:38.399531 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:38.399632 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:38.399932 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:38.399937 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:38.400145 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:38.400252 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:38.400257 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.400980 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.400983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:38.401554 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:38.401562 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.401970 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.401973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:38.402035 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:38.402521 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:38.402533 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:38.404552 (+ 2019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":100,"threads_started":1}
W20260808 08:30:38.404789 3360 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:38.399342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:49705 (local address 127.25.170.62:37701)
0808 08:30:38.399484 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:38.399488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:38.399602 (+ 114us) server_negotiation.cc:407] Connection header received
0808 08:30:38.399713 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:38.399716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:38.399762 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:38.399847 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:38.400355 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.400883 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.401654 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.401872 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.401946 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:38.404679 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:49705: BlockingRecv error: recv got EOF from 127.25.170.2:49705 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 08:30:38 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:38 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:38.653429 3362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:38.646316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:43733)
0808 08:30:38.646623 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:38.646637 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:38.646734 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:38.647014 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:38.647016 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:38.647179 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:38.647274 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:38.647279 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.648587 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.648591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:38.649241 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:38.649252 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.649985 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.649989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:38.650091 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:38.650798 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:38.650820 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:38.653304 (+ 2484us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":82,"threads_started":1}
W20260808 08:30:38.653664 3360 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:38.646424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:43733 (local address 127.25.170.62:37701)
0808 08:30:38.646596 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:38.646603 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:38.646707 (+ 104us) server_negotiation.cc:407] Connection header received
0808 08:30:38.646820 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:38.646826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:38.646892 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:38.646987 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:38.647416 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.648444 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.649381 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:38.649823 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:38.649953 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:38.653498 (+ 3545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:43733: BlockingRecv error: recv got EOF from 127.25.170.3:43733 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 08:30:39 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:39 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:39.204922 3363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:39.199207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:35875)
0808 08:30:39.199614 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:39.199627 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:39.199757 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:39.200125 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:39.200128 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:39.200345 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:39.200449 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:39.200454 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.201181 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.201183 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:39.201726 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:39.201732 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.202153 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.202156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:39.202215 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:39.202768 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:39.202779 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:39.204752 (+ 1973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":91,"threads_started":1}
W20260808 08:30:39.204984 3364 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:39.199260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:35875 (local address 127.25.170.62:37701)
0808 08:30:39.199508 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:39.199532 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:39.199725 (+ 193us) server_negotiation.cc:407] Connection header received
0808 08:30:39.199874 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:39.199877 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:39.199955 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:39.200070 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:39.200557 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.201087 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.201833 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.202053 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.202133 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:39.204864 (+ 2731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:35875: BlockingRecv error: recv got EOF from 127.25.170.1:35875 (error 108)
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":64,"threads_started":1}
Aug 08 08:30:39 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:39 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:39.413138 3365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:39.405624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:57829)
0808 08:30:39.405880 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:39.405894 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:39.406033 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:39.406329 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:39.406333 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:39.406574 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:39.406712 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:39.406718 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.407829 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.407832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:39.408822 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:39.408837 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.409544 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.409550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:39.409667 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:39.410260 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:39.410275 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:39.412925 (+ 2650us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":88,"threads_started":1}
W20260808 08:30:39.413378 3364 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:39.405669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:57829 (local address 127.25.170.62:37701)
0808 08:30:39.405823 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:39.405827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:39.405983 (+ 156us) server_negotiation.cc:407] Connection header received
0808 08:30:39.406133 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:39.406136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:39.406194 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:39.406288 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:39.406866 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.407698 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.408972 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.409389 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.409524 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:39.413088 (+ 3564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:57829: BlockingRecv error: recv got EOF from 127.25.170.2:57829 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 08:30:39 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:39 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:39.660172 3366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:39.654370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:34937)
0808 08:30:39.654670 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:39.654684 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:39.654777 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:39.655075 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:39.655078 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:39.655282 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:39.655400 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:39.655406 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.656163 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.656165 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:39.656740 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:39.656749 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.657414 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.657418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:39.657508 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:39.658199 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:39.658221 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:39.660057 (+ 1836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":121,"threads_started":1}
W20260808 08:30:39.660311 3364 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:39.654494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:34937 (local address 127.25.170.62:37701)
0808 08:30:39.654642 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:39.654653 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:39.654749 (+ 96us) server_negotiation.cc:407] Connection header received
0808 08:30:39.654865 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:39.654867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:39.654913 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:39.654984 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:39.655517 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.656057 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.656881 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:39.657284 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:39.657396 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:39.660189 (+ 2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:34937: BlockingRecv error: recv got EOF from 127.25.170.3:34937 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 08:30:40 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:40 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:40.211395 3367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:40.205693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:36201)
0808 08:30:40.206015 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:40.206029 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:40.206124 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:40.206408 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:40.206411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:40.206642 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:40.206754 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:40.206760 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.207711 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.207716 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:40.208292 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:40.208300 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.208768 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.208771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:40.208863 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:40.209417 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:40.209430 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:40.211210 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":103,"threads_started":1}
W20260808 08:30:40.211478 3368 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:40.205812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:36201 (local address 127.25.170.62:37701)
0808 08:30:40.206062 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:40.206066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:40.206078 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:30:40.206215 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:40.206217 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:40.206261 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:40.206343 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:40.206888 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.207590 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.208416 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.208648 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.208761 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:40.211347 (+ 2586us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:36201: BlockingRecv error: recv got EOF from 127.25.170.1:36201 (error 108)
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":64,"threads_started":1}
Aug 08 08:30:40 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:40 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:40.419713 3369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:40.414248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:47255)
0808 08:30:40.414516 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:40.414530 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:40.414633 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:40.414870 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:40.414873 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:40.415063 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:40.415165 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:40.415171 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.416018 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.416022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:40.416589 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:40.416598 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.417094 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.417097 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:40.417167 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:40.417671 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:40.417682 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:40.419540 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":95,"threads_started":1}
W20260808 08:30:40.419771 3368 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:40.414279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:47255 (local address 127.25.170.62:37701)
0808 08:30:40.414439 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:40.414444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:40.414601 (+ 157us) server_negotiation.cc:407] Connection header received
0808 08:30:40.414716 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:40.414718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:40.414766 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:40.414832 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:40.415272 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.415836 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.416700 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.416971 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.417062 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:40.419664 (+ 2602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:47255: BlockingRecv error: recv got EOF from 127.25.170.2:47255 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 08:30:40 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:40 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:40.666745 3370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:40.661145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:36781)
0808 08:30:40.661420 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:40.661434 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:40.661532 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:40.661783 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:40.661785 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:40.661963 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:40.662064 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:40.662069 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.662767 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.662770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:40.663325 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:40.663332 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.663804 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.663808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:40.663878 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:40.664472 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:40.664485 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:40.666617 (+ 2132us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":91,"threads_started":1}
W20260808 08:30:40.666870 3368 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:40.661190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:36781 (local address 127.25.170.62:37701)
0808 08:30:40.661334 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:40.661337 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:40.661502 (+ 165us) server_negotiation.cc:407] Connection header received
0808 08:30:40.661613 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:40.661615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:40.661661 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:40.661737 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:40.662164 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.662675 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.663422 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:40.663634 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:40.663710 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:40.666751 (+ 3041us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:36781: BlockingRecv error: recv got EOF from 127.25.170.3:36781 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 08:30:41 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:41 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:41.217706 3371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:41.212231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:47305)
0808 08:30:41.212531 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:41.212546 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:41.212639 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:41.212892 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:41.212894 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:41.213081 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:41.213182 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:41.213187 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.213935 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.213937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:41.214566 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:41.214576 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.215043 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.215047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:41.215134 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:41.215702 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:41.215714 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:41.217535 (+ 1821us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":74,"threads_started":1}
W20260808 08:30:41.217799 3372 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:41.212294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:47305 (local address 127.25.170.62:37701)
0808 08:30:41.212581 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:41.212584 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:41.212598 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:41.212726 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:41.212728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:41.212773 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:41.212851 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:41.213293 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.213839 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.214688 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.214926 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.215036 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:41.217667 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:47305: BlockingRecv error: recv got EOF from 127.25.170.1:47305 (error 108)
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":100,"threads_started":1}
Aug 08 08:30:41 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:41 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:41.426515 3373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:41.420695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:46991)
0808 08:30:41.421023 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:41.421041 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:41.421332 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:41.421648 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:41.421651 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:41.421920 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:41.422085 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:41.422096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.422910 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.422913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:41.423481 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:41.423489 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.423923 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.423925 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:41.423989 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:41.424548 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:41.424564 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:41.426390 (+ 1826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":96,"threads_started":1}
W20260808 08:30:41.426648 3372 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:41.420808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:46991 (local address 127.25.170.62:37701)
0808 08:30:41.421002 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:41.421007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:41.421126 (+ 119us) server_negotiation.cc:407] Connection header received
0808 08:30:41.421450 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:41.421453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:41.421507 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:41.421594 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:41.422214 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.422807 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.423581 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.423796 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.423876 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:41.426532 (+ 2656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:46991: BlockingRecv error: recv got EOF from 127.25.170.2:46991 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 08 08:30:41 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:41 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:41.678056 3374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:41.667527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:56543)
0808 08:30:41.667816 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:41.667830 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:41.667992 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:41.668254 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:41.668256 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:41.668447 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:41.668549 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:41.668555 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.669264 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.669267 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:41.669818 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:41.669825 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.670229 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.670231 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:41.670304 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:41.675834 (+ 5530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:41.675847 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:41.677923 (+ 2076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":103,"threads_started":1}
W20260808 08:30:41.678189 3372 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:41.667657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:56543 (local address 127.25.170.62:37701)
0808 08:30:41.667823 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:41.667827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:41.667881 (+ 54us) server_negotiation.cc:407] Connection header received
0808 08:30:41.668078 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:41.668080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:41.668144 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:41.668213 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:41.668650 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.669171 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.669913 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:41.670131 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:41.670207 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:41.678056 (+ 7849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:56543: BlockingRecv error: recv got EOF from 127.25.170.3:56543 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 08:30:42 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:42 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:42.224718 3376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:42.218613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:47705)
0808 08:30:42.218982 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:42.218997 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:42.219112 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:42.219437 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:42.219440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:42.219694 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:42.219840 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:42.219848 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.220783 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.220788 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:42.221425 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:42.221433 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.221982 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.221985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:42.222083 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:42.222616 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:42.222629 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:42.224590 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":140,"threads_started":1}
W20260808 08:30:42.224891 3375 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:42.218641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:47705 (local address 127.25.170.62:37701)
0808 08:30:42.218954 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:42.218961 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:42.219082 (+ 121us) server_negotiation.cc:407] Connection header received
0808 08:30:42.219237 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:42.219239 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:42.219289 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:42.219409 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:42.220035 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.220643 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.221559 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.221850 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.221977 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:42.224720 (+ 2743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:47705: BlockingRecv error: recv got EOF from 127.25.170.1:47705 (error 108)
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":85,"threads_started":1}
Aug 08 08:30:42 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:42 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:42.432984 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:42.427387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:59651)
0808 08:30:42.427698 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:42.427712 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:42.427828 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:42.428212 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:42.428215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:42.428426 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:42.428536 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:42.428543 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.429293 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.429296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:42.429922 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:42.429930 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.430363 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.430366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:42.430439 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:42.430959 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:42.430972 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:42.432857 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":115,"threads_started":1}
W20260808 08:30:42.433105 3375 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:42.427504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:59651 (local address 127.25.170.62:37701)
0808 08:30:42.427675 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:42.427678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:42.427792 (+ 114us) server_negotiation.cc:407] Connection header received
0808 08:30:42.427988 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:42.427993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:42.428059 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:42.428135 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:42.428659 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.429180 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.430029 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.430254 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.430333 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:42.432989 (+ 2656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:59651: BlockingRecv error: recv got EOF from 127.25.170.2:59651 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 08:30:42 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:42 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:42.684330 3378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:42.678854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:41207)
0808 08:30:42.679138 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:42.679151 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:42.679285 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:42.679566 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:42.679569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:42.679816 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:42.679992 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:42.679998 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.680846 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.680850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:42.681425 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:42.681433 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.681897 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.681901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:42.681986 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:42.682456 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:42.682467 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:42.684210 (+ 1743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":88,"threads_started":1}
W20260808 08:30:42.684489 3375 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:42.678905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:41207 (local address 127.25.170.62:37701)
0808 08:30:42.679057 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:42.679062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:42.679225 (+ 163us) server_negotiation.cc:407] Connection header received
0808 08:30:42.679392 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:42.679396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:42.679449 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:42.679544 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:42.680124 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.680724 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.681548 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:42.681783 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:42.681891 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:42.684342 (+ 2451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:41207: BlockingRecv error: recv got EOF from 127.25.170.3:41207 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 08:30:43 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:43 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:43.231383 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:43.225525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:57717)
0808 08:30:43.225915 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:43.225940 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:43.226070 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:43.226442 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:43.226445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:43.226724 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:43.226873 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:43.226882 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.227746 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.227749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:43.228413 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:43.228422 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.228850 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.228852 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:43.228918 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:43.229419 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:43.229431 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:43.231267 (+ 1836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":123,"threads_started":1}
W20260808 08:30:43.231577 3380 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:43.225665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:57717 (local address 127.25.170.62:37701)
0808 08:30:43.226031 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:43.226036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:43.226058 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:30:43.226175 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:43.226181 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:43.226263 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:43.226385 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:43.227019 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.227631 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.228525 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.228745 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.228824 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:43.231420 (+ 2596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:57717: BlockingRecv error: recv got EOF from 127.25.170.1:57717 (error 108)
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":79,"threads_started":1}
Aug 08 08:30:43 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:43 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:43.439231 3381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:43.433910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:48141)
0808 08:30:43.434242 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:43.434256 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:43.434360 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:43.434588 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:43.434590 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:43.434788 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:43.434887 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:43.434892 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.435618 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.435621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:43.436302 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:43.436313 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.436713 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.436716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:43.436800 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:43.437299 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:43.437311 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:43.439095 (+ 1784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":110,"threads_started":1}
W20260808 08:30:43.439354 3380 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:43.434001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:48141 (local address 127.25.170.62:37701)
0808 08:30:43.434177 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:43.434183 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:43.434329 (+ 146us) server_negotiation.cc:407] Connection header received
0808 08:30:43.434426 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:43.434428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:43.434474 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:43.434539 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:43.434987 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.435499 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.436408 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.436618 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.436693 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:43.439230 (+ 2537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:48141: BlockingRecv error: recv got EOF from 127.25.170.2:48141 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 08:30:43 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:43 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.3@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:43.690882 3382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:43.685094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.3:33575)
0808 08:30:43.685378 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:43.685411 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:43.685545 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:43.685868 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:43.685872 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:43.686113 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:43.686267 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:43.686275 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.687058 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.687060 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:43.687790 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:43.687801 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.688278 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.688284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:43.688351 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:43.688965 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:43.688978 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:43.690767 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":115,"threads_started":1}
W20260808 08:30:43.691026 3380 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:43.685172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:33575 (local address 127.25.170.62:37701)
0808 08:30:43.685317 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:43.685321 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:43.685511 (+ 190us) server_negotiation.cc:407] Connection header received
0808 08:30:43.685652 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:43.685655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:43.685719 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:43.685831 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:43.686389 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.686956 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.687933 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:43.688157 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:43.688239 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:43.690904 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.3:33575: BlockingRecv error: recv got EOF from 127.25.170.3:33575 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 08:30:44 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:44 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.1@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:44.237980 3383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:44.232336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.1:47783)
0808 08:30:44.232693 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:44.232711 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:44.232824 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:44.233180 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:44.233182 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:44.233429 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:44.233584 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:44.233593 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:44.234426 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:44.234429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:44.234984 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:44.234992 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:44.235395 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:44.235398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:44.235457 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:44.236010 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:44.236031 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:44.237855 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":132,"threads_started":1}
W20260808 08:30:44.238153 3384 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:44.232415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:47783 (local address 127.25.170.62:37701)
0808 08:30:44.232753 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:44.232757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:44.232795 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:30:44.232951 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:44.232954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:44.233033 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:44.233125 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:44.233729 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:44.234326 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:44.235084 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:44.235301 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:44.235375 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:44.237982 (+ 2607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.1:47783: BlockingRecv error: recv got EOF from 127.25.170.1:47783 (error 108)
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":92,"threads_started":1}
Aug 08 08:30:44 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:30:44 dist-test-slave-zkpd krb5kdc[2308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.170.2@KRBTEST.COM for oryx/127.25.170.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:30:44.446244 3385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:44.441084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:37701 (local address 127.25.170.2:55809)
0808 08:30:44.441379 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:44.441392 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:44.441486 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:44.441705 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:44.441707 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:44.441888 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:44.441993 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:44.441998 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:44.442728 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:44.442730 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:44.443265 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:44.443271 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:44.443676 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:44.443679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:44.443744 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:44.444258 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:44.444271 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:44.446119 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.170.62:37701: Server oryx/127.25.170.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":93,"threads_started":1}
W20260808 08:30:44.446386 3384 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:44.441219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:55809 (local address 127.25.170.62:37701)
0808 08:30:44.441372 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:44.441375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:44.441445 (+ 70us) server_negotiation.cc:407] Connection header received
0808 08:30:44.441562 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:44.441564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:44.441606 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:44.441665 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:44.442097 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:44.442620 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:44.443370 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:44.443577 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:44.443656 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:44.446254 (+ 2598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.170.2:55809: BlockingRecv error: recv got EOF from 127.25.170.2:55809 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:30:44.564872 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 2903
I20260808 08:30:44.573366 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 3058
I20260808 08:30:44.580080 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 3191
I20260808 08:30:44.586444 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 2830
2026-08-08T08:30:44Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18123 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T08:30:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:44Z Disabled control of system clock
I20260808 08:30:44.618572 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:34467
--webserver_interface=127.25.170.62
--webserver_port=0
--builtin_ntp_servers=127.25.170.20:37771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:34467
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 08:30:44.729270 3389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:44.729516 3389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:44.729548 3389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:44.733589 3389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:44.733640 3389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:44.733655 3389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:44.733672 3389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:44.733687 3389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:44.738330 3389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:37771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:34467
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:34467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:44.739338 3389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:44.740782 3389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:44.749920 3395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:44.749969 3389 server_base.cc:1034] running on GCE node
W20260808 08:30:44.749969 3394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:44.750198 3397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:44.750767 3389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:44.751791 3389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:44.752957 3389 hybrid_clock.cc:648] HybridClock initialized: now 1786177844752940 us; error 34 us; skew 500 ppm
I20260808 08:30:44.754805 3389 webserver.cc:460] Webserver started at http://127.25.170.62:43581/ using document root <none> and password file <none>
I20260808 08:30:44.755355 3389 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:44.755419 3389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:44.755591 3389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:44.757743 3389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "4a2bf4524155444189ebd45117e69438"
format_stamp: "Formatted at 2026-08-08 08:30:44 on dist-test-slave-zkpd"
server_key: "dc12c7c80313cbbc91649e9eb250f670"
server_key_iv: "e6e7827a565ef2d24d52d2cd87e088c9"
server_key_version: "encryptionkey@0"
I20260808 08:30:44.758313 3389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "4a2bf4524155444189ebd45117e69438"
format_stamp: "Formatted at 2026-08-08 08:30:44 on dist-test-slave-zkpd"
server_key: "dc12c7c80313cbbc91649e9eb250f670"
server_key_iv: "e6e7827a565ef2d24d52d2cd87e088c9"
server_key_version: "encryptionkey@0"
I20260808 08:30:44.762073 3389 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:30:44.764536 3403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:44.765828 3389 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:44.765973 3389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "4a2bf4524155444189ebd45117e69438"
format_stamp: "Formatted at 2026-08-08 08:30:44 on dist-test-slave-zkpd"
server_key: "dc12c7c80313cbbc91649e9eb250f670"
server_key_iv: "e6e7827a565ef2d24d52d2cd87e088c9"
server_key_version: "encryptionkey@0"
I20260808 08:30:44.766085 3389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:44.775455 3389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:44.776134 3389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:44.776326 3389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:44.783200 3389 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:34467
I20260808 08:30:44.783203 3456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:34467 every 8 connection(s)
I20260808 08:30:44.784268 3389 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:44.787389 3457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:44.792783 3457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438: Bootstrap starting.
I20260808 08:30:44.794317 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 3389
I20260808 08:30:44.794433 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:44.794731 26280 external_mini_cluster.cc:1428] Setting key f638ede22939e196bb4eb4b4987adc5a
I20260808 08:30:44.795562 3457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:44.796537 3457 log.cc:824] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:44.798385 3457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438: No bootstrap required, opened a new log
I20260808 08:30:44.801965 3457 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2bf4524155444189ebd45117e69438" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34467 } }
I20260808 08:30:44.802199 3457 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:44.802296 3457 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a2bf4524155444189ebd45117e69438, State: Initialized, Role: FOLLOWER
I20260808 08:30:44.802798 3457 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2bf4524155444189ebd45117e69438" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34467 } }
I20260808 08:30:44.802994 3457 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:44.803066 3457 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:44.803165 3457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:44.803718 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:44.795933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47810 (local address 127.25.170.62:34467)
0808 08:30:44.796585 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:44.796598 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:44.796633 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:30:44.797301 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:44.797318 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:44.797630 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:44.797948 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:44.798370 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:44.799363 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:44.800330 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:44.800795 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:44.800978 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:44.801836 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:44.801841 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:44.801853 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:44.802244 (+ 391us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:44.802343 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:44.802371 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:44.802485 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:44.802633 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 08:30:44.802879 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":129,"threads_started":1}
I20260808 08:30:44.804147 3457 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2bf4524155444189ebd45117e69438" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34467 } }
I20260808 08:30:44.804481 3457 leader_election.cc:302] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a2bf4524155444189ebd45117e69438; no voters:
I20260808 08:30:44.804831 3457 leader_election.cc:288] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:44.804930 3462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:44.805166 3462 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [term 1 LEADER]: Becoming Leader. State: Replica: 4a2bf4524155444189ebd45117e69438, State: Running, Role: LEADER
I20260808 08:30:44.805486 3462 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2bf4524155444189ebd45117e69438" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34467 } }
I20260808 08:30:44.806093 3457 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:44.806686 3462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a2bf4524155444189ebd45117e69438. Latest consensus state: current_term: 1 leader_uuid: "4a2bf4524155444189ebd45117e69438" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2bf4524155444189ebd45117e69438" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34467 } } }
I20260808 08:30:44.806887 3462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:44.807339 3470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:44.807938 3463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a2bf4524155444189ebd45117e69438" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2bf4524155444189ebd45117e69438" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 34467 } } }
I20260808 08:30:44.808051 3463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:44.810863 3470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:44.815840 3470 catalog_manager.cc:1347] Generated new cluster ID: 4d129f692cd24a23bf55c86883b1b787
I20260808 08:30:44.815917 3470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:44.828313 3470 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:44.829419 3470 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:44.840819 3470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a2bf4524155444189ebd45117e69438: Generated new TSK 0
I20260808 08:30:44.841503 3470 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:30:44.844789 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34467
--builtin_ntp_servers=127.25.170.20:37771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 08:30:44.956743 3481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:44.957034 3481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:44.957110 3481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:44.961127 3481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:44.961200 3481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:44.961282 3481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:44.965936 3481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:37771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:44.966995 3481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:44.968441 3481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:44.978017 3487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:44.978047 3486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:44.978088 3489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:44.978160 3481 server_base.cc:1034] running on GCE node
I20260808 08:30:44.978592 3481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:44.979216 3481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:44.980383 3481 hybrid_clock.cc:648] HybridClock initialized: now 1786177844980367 us; error 25 us; skew 500 ppm
I20260808 08:30:44.982208 3481 webserver.cc:460] Webserver started at http://127.25.170.1:45637/ using document root <none> and password file <none>
I20260808 08:30:44.982776 3481 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:44.982838 3481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:44.983096 3481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:44.987238 3481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "a4c4afe96d754a2baa4461037856337b"
format_stamp: "Formatted at 2026-08-08 08:30:44 on dist-test-slave-zkpd"
server_key: "a76a97e5d10c3391d639618d9b7a6b87"
server_key_iv: "6b9b745a826ef715f129ed6ed0b6f640"
server_key_version: "encryptionkey@0"
I20260808 08:30:44.987849 3481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "a4c4afe96d754a2baa4461037856337b"
format_stamp: "Formatted at 2026-08-08 08:30:44 on dist-test-slave-zkpd"
server_key: "a76a97e5d10c3391d639618d9b7a6b87"
server_key_iv: "6b9b745a826ef715f129ed6ed0b6f640"
server_key_version: "encryptionkey@0"
I20260808 08:30:44.991540 3481 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:30:44.994254 3495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:44.995430 3481 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:44.995568 3481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "a4c4afe96d754a2baa4461037856337b"
format_stamp: "Formatted at 2026-08-08 08:30:44 on dist-test-slave-zkpd"
server_key: "a76a97e5d10c3391d639618d9b7a6b87"
server_key_iv: "6b9b745a826ef715f129ed6ed0b6f640"
server_key_version: "encryptionkey@0"
I20260808 08:30:44.995682 3481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:45.025812 3481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:45.026515 3481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:45.026758 3481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:45.027374 3481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:45.028466 3481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:45.028539 3481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.028611 3481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:45.028654 3481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.037861 3481 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:39307
I20260808 08:30:45.037915 3610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:39307 every 8 connection(s)
I20260808 08:30:45.038777 3481 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:45.041899 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 3481
I20260808 08:30:45.042017 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:45.042341 26280 external_mini_cluster.cc:1428] Setting key 8d40bdcffb2619bbfc134ba7b15041ad
I20260808 08:30:45.044577 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34467
--builtin_ntp_servers=127.25.170.20:37771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 08:30:45.049176 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:45.040562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:34827 (local address 127.25.170.62:34467)
0808 08:30:45.040713 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:45.040718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:45.041980 (+ 1262us) server_negotiation.cc:407] Connection header received
0808 08:30:45.043873 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:45.043876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:45.043952 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:45.044023 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:45.045275 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.045851 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.047172 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.047438 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.047563 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:45.048689 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:45.048693 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:45.048696 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:45.048708 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:45.048734 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:45.048742 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:45.048823 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:45.048978 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 08:30:45.049040 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:30:45.050084 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:45.041021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:34467 (local address 127.25.170.1:34827)
0808 08:30:45.041763 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:45.041835 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:45.043485 (+ 1650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:45.044227 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:45.044236 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:45.044339 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:45.045046 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:45.045069 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.045986 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.045992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:45.047041 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:45.047051 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.047603 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.047607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:45.047775 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:45.048430 (+ 655us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:45.048432 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:45.048471 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:45.048532 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:45.048825 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:45.048837 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:45.048844 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:30:45.048977 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 08:30:45.049254 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":117,"threads_started":1}
I20260808 08:30:45.051640 3611 heartbeater.cc:347] Connected to a master server at 127.25.170.62:34467
I20260808 08:30:45.051911 3611 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:45.052606 3611 heartbeater.cc:511] Master 127.25.170.62:34467 requested a full tablet report, sending...
I20260808 08:30:45.054801 3420 ts_manager.cc:194] Registered new tserver with Master: a4c4afe96d754a2baa4461037856337b (127.25.170.1:39307)
I20260808 08:30:45.056563 3420 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.1:34827
W20260808 08:30:45.159582 3614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:45.159847 3614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:45.159884 3614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:45.163851 3614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:45.163950 3614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:45.164011 3614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:45.168574 3614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:37771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:45.169536 3614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:45.170928 3614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:45.180330 3622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:45.180485 3614 server_base.cc:1034] running on GCE node
W20260808 08:30:45.180533 3620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:45.180374 3619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:45.181046 3614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:45.181631 3614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:45.182824 3614 hybrid_clock.cc:648] HybridClock initialized: now 1786177845182808 us; error 26 us; skew 500 ppm
I20260808 08:30:45.184643 3614 webserver.cc:460] Webserver started at http://127.25.170.2:37231/ using document root <none> and password file <none>
I20260808 08:30:45.185211 3614 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:45.185303 3614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:45.185514 3614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:45.187475 3614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "ed2f734cc318465f94422e2859461c75"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "a887170e0b624c9659bc36c2b58db973"
server_key_iv: "7c1d0cd974374ed46cd0e97413673201"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.188097 3614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "ed2f734cc318465f94422e2859461c75"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "a887170e0b624c9659bc36c2b58db973"
server_key_iv: "7c1d0cd974374ed46cd0e97413673201"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.191618 3614 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:30:45.194120 3628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.195295 3614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:30:45.195428 3614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "ed2f734cc318465f94422e2859461c75"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "a887170e0b624c9659bc36c2b58db973"
server_key_iv: "7c1d0cd974374ed46cd0e97413673201"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.195538 3614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:45.211555 3614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:45.212224 3614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:45.212409 3614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:45.212960 3614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:45.213868 3614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:45.213937 3614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.214008 3614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:45.214051 3614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.222681 3614 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:39881
I20260808 08:30:45.222707 3747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:39881 every 8 connection(s)
I20260808 08:30:45.223556 3614 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:45.231724 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 3614
I20260808 08:30:45.231871 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:45.232172 26280 external_mini_cluster.cc:1428] Setting key 82ad3d24214866bc73961ce89fa79359
I20260808 08:30:45.232651 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:45.225351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:48929 (local address 127.25.170.62:34467)
0808 08:30:45.225482 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:45.225485 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:45.226480 (+ 995us) server_negotiation.cc:407] Connection header received
0808 08:30:45.227927 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:45.227930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:45.227992 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:45.228094 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:45.228960 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.229511 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.230648 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.230872 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.230982 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:45.232149 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:45.232153 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:45.232160 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:45.232171 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:45.232190 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:45.232197 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:45.232278 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:45.232446 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 08:30:45.232508 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:30:45.233609 3750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:45.225661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:34467 (local address 127.25.170.2:48929)
0808 08:30:45.226329 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:45.226368 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:45.227669 (+ 1301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:45.228265 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:45.228273 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:45.228355 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:45.228815 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:45.228827 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.229639 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.229648 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:45.230522 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:45.230532 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.231023 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.231027 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:45.231184 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:45.231804 (+ 620us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:45.231806 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:45.231874 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:45.231986 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:45.232286 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:45.232297 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:45.232305 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 08:30:45.232441 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 08:30:45.232710 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":139,"threads_started":1}
I20260808 08:30:45.234220 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34467
--builtin_ntp_servers=127.25.170.20:37771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 08:30:45.234807 3748 heartbeater.cc:347] Connected to a master server at 127.25.170.62:34467
I20260808 08:30:45.235036 3748 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:45.235525 3748 heartbeater.cc:511] Master 127.25.170.62:34467 requested a full tablet report, sending...
I20260808 08:30:45.236613 3420 ts_manager.cc:194] Registered new tserver with Master: ed2f734cc318465f94422e2859461c75 (127.25.170.2:39881)
I20260808 08:30:45.237448 3420 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.2:48929
W20260808 08:30:45.348059 3751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:45.348280 3751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:45.348315 3751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:45.352270 3751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:45.352314 3751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:45.352365 3751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:45.357425 3751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:37771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:34467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:45.358361 3751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:45.359611 3751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:45.369040 3757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:45.369093 3756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:45.369284 3751 server_base.cc:1034] running on GCE node
W20260808 08:30:45.369093 3759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:45.369889 3751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:45.370469 3751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:45.371665 3751 hybrid_clock.cc:648] HybridClock initialized: now 1786177845371647 us; error 29 us; skew 500 ppm
I20260808 08:30:45.373556 3751 webserver.cc:460] Webserver started at http://127.25.170.3:37309/ using document root <none> and password file <none>
I20260808 08:30:45.374133 3751 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:45.374234 3751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:45.374487 3751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:45.376798 3751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "db4ac3551c1343e5b4965046be9c8398"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "6332f5c1cf9f2bfe30f077a5fc9be37f"
server_key_iv: "d9ddebf0f287436df386c4bf8e047184"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.377351 3751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "db4ac3551c1343e5b4965046be9c8398"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "6332f5c1cf9f2bfe30f077a5fc9be37f"
server_key_iv: "d9ddebf0f287436df386c4bf8e047184"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.380831 3751 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:30:45.383155 3765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.384375 3751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:45.384465 3751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "db4ac3551c1343e5b4965046be9c8398"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "6332f5c1cf9f2bfe30f077a5fc9be37f"
server_key_iv: "d9ddebf0f287436df386c4bf8e047184"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.384547 3751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:45.395666 3751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:45.396340 3751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:45.396474 3751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:45.396960 3751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:45.397828 3751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:45.397873 3751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.397910 3751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:45.397925 3751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.407106 3751 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:38739
I20260808 08:30:45.407140 3881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:38739 every 8 connection(s)
I20260808 08:30:45.408104 3751 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:45.411355 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 3751
I20260808 08:30:45.411469 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:45.411736 26280 external_mini_cluster.cc:1428] Setting key 4918dfebe5b501d41ada5d8fd6b1c955
I20260808 08:30:45.417485 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:45.409845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:45213 (local address 127.25.170.62:34467)
0808 08:30:45.409976 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:45.409984 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:45.411015 (+ 1031us) server_negotiation.cc:407] Connection header received
0808 08:30:45.412664 (+ 1649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:45.412667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:45.412727 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:45.412833 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:45.413694 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.414354 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.415486 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.415717 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.415829 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:45.416960 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:45.416964 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:45.416967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:45.416986 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:45.417004 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:45.417012 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:45.417091 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:45.417283 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 08:30:45.417347 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 08:30:45.418290 3884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:45.410173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:34467 (local address 127.25.170.3:45213)
0808 08:30:45.410861 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:45.410906 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:45.412459 (+ 1553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:45.413013 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:45.413020 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:45.413101 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:45.413554 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:45.413566 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.414482 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.414485 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:45.415357 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:45.415366 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:45.415868 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:45.415872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:45.416067 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:45.416603 (+ 536us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:45.416605 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:45.416652 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:45.416718 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:45.417107 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:45.417116 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:45.417122 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 08:30:45.417257 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 08:30:45.417531 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":111,"threads_started":1}
I20260808 08:30:45.419335 3882 heartbeater.cc:347] Connected to a master server at 127.25.170.62:34467
I20260808 08:30:45.419553 3882 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:45.420104 3882 heartbeater.cc:511] Master 127.25.170.62:34467 requested a full tablet report, sending...
I20260808 08:30:45.421108 3420 ts_manager.cc:194] Registered new tserver with Master: db4ac3551c1343e5b4965046be9c8398 (127.25.170.3:38739)
I20260808 08:30:45.421661 3420 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.3:45213
I20260808 08:30:45.425650 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:30:45.428504 3460 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:45.427591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47818 (local address 127.25.170.62:34467)
0808 08:30:45.427736 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:45.427740 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:45.427950 (+ 210us) server_negotiation.cc:407] Connection header received
0808 08:30:45.428020 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:45.428022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:45.428062 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:45.428122 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:45.428360 (+ 238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47818: BlockingRecv error: recv got EOF from 127.0.0.1:47818 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:30:45.428578 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 3481
I20260808 08:30:45.437520 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 3614
I20260808 08:30:45.444253 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 3751
I20260808 08:30:45.452637 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 3389
2026-08-08T08:30:45Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (865 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T08:30:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:45Z Disabled control of system clock
I20260808 08:30:45.484344 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39033
--webserver_interface=127.25.170.62
--webserver_port=0
--builtin_ntp_servers=127.25.170.20:43249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:39033
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 08:30:45.594694 3893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:45.594933 3893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:45.594967 3893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:45.599009 3893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:45.599058 3893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:45.599074 3893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:45.599121 3893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:45.599148 3893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:45.603863 3893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:43249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:39033
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:45.604900 3893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:45.606281 3893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:45.614773 3898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:45.614779 3899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:45.614823 3901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:45.614969 3893 server_base.cc:1034] running on GCE node
I20260808 08:30:45.615625 3893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:45.616794 3893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:45.617985 3893 hybrid_clock.cc:648] HybridClock initialized: now 1786177845617958 us; error 42 us; skew 500 ppm
I20260808 08:30:45.619778 3893 webserver.cc:460] Webserver started at http://127.25.170.62:32971/ using document root <none> and password file <none>
I20260808 08:30:45.620389 3893 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:45.620499 3893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:45.620731 3893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:45.622756 3893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "b0e4c1074bb744a38a09616a59e8dcc4"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "c5c26ee2f582fabfef58e300cecbfd6e"
server_key_iv: "7c9256cbf998d08b9f5786f083001a68"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.623324 3893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "b0e4c1074bb744a38a09616a59e8dcc4"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "c5c26ee2f582fabfef58e300cecbfd6e"
server_key_iv: "7c9256cbf998d08b9f5786f083001a68"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.626832 3893 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:30:45.629227 3907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.630400 3893 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:45.630498 3893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "b0e4c1074bb744a38a09616a59e8dcc4"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "c5c26ee2f582fabfef58e300cecbfd6e"
server_key_iv: "7c9256cbf998d08b9f5786f083001a68"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.630577 3893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:45.634920 3893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:45.635438 3893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:45.635565 3893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:45.642141 3893 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:39033
I20260808 08:30:45.642163 3961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:39033 every 8 connection(s)
I20260808 08:30:45.642977 3893 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:45.646067 3962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:45.649716 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 3893
I20260808 08:30:45.649814 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:45.650084 26280 external_mini_cluster.cc:1428] Setting key efe844c8dfa8d095c572c92ae4e1d744
I20260808 08:30:45.651731 3962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4: Bootstrap starting.
I20260808 08:30:45.654390 3962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:45.655294 3962 log.cc:824] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:45.656430 3965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:45.651447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56150 (local address 127.25.170.62:39033)
0808 08:30:45.652131 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:45.652150 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:45.652189 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:30:45.653048 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:45.653070 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:45.653492 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:45.653870 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:45.654949 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:45.654954 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:45.654968 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:45.654978 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:45.655034 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:45.655059 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:45.655170 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:45.655290 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 08:30:45.655566 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":111,"threads_started":1}
I20260808 08:30:45.657498 3962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4: No bootstrap required, opened a new log
I20260808 08:30:45.661002 3962 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e4c1074bb744a38a09616a59e8dcc4" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39033 } }
I20260808 08:30:45.661191 3962 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:45.661268 3962 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0e4c1074bb744a38a09616a59e8dcc4, State: Initialized, Role: FOLLOWER
I20260808 08:30:45.661725 3962 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e4c1074bb744a38a09616a59e8dcc4" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39033 } }
I20260808 08:30:45.661865 3962 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:45.661927 3962 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:45.662050 3962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:45.662871 3962 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e4c1074bb744a38a09616a59e8dcc4" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39033 } }
I20260808 08:30:45.663225 3962 leader_election.cc:302] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0e4c1074bb744a38a09616a59e8dcc4; no voters:
I20260808 08:30:45.663580 3962 leader_election.cc:288] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:45.663676 3967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:45.663944 3967 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [term 1 LEADER]: Becoming Leader. State: Replica: b0e4c1074bb744a38a09616a59e8dcc4, State: Running, Role: LEADER
I20260808 08:30:45.664263 3967 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e4c1074bb744a38a09616a59e8dcc4" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39033 } }
I20260808 08:30:45.664798 3962 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:45.665912 3969 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0e4c1074bb744a38a09616a59e8dcc4. Latest consensus state: current_term: 1 leader_uuid: "b0e4c1074bb744a38a09616a59e8dcc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e4c1074bb744a38a09616a59e8dcc4" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39033 } } }
I20260808 08:30:45.666036 3969 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:45.665921 3968 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0e4c1074bb744a38a09616a59e8dcc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0e4c1074bb744a38a09616a59e8dcc4" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39033 } } }
I20260808 08:30:45.666373 3968 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:45.667397 3976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:45.669817 3976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:45.674775 3976 catalog_manager.cc:1347] Generated new cluster ID: f25da3b4a50042b59f007c006793e74e
I20260808 08:30:45.674844 3976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:45.701606 3976 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:45.701932 3976 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:45.713093 3976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0e4c1074bb744a38a09616a59e8dcc4: Generated new TSK 0
I20260808 08:30:45.713748 3976 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:30:45.720976 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39033
--builtin_ntp_servers=127.25.170.20:43249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 08:30:45.831912 3986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:45.832163 3986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:45.832226 3986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:45.836284 3986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:45.836351 3986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:45.836452 3986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:45.841037 3986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:43249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:45.841996 3986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:45.843329 3986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:45.852481 3994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:45.852500 3992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:45.852496 3991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:45.852723 3986 server_base.cc:1034] running on GCE node
I20260808 08:30:45.853147 3986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:45.853739 3986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:45.854915 3986 hybrid_clock.cc:648] HybridClock initialized: now 1786177845854901 us; error 24 us; skew 500 ppm
I20260808 08:30:45.856675 3986 webserver.cc:460] Webserver started at http://127.25.170.1:37713/ using document root <none> and password file <none>
I20260808 08:30:45.857251 3986 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:45.857353 3986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:45.857577 3986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:45.859515 3986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "3217744321ab46c2ba09e90d7e895653"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "ec8b4e77b0b5ed481d667ccdd0412b31"
server_key_iv: "fb72370c84551af31b21582ae5a80067"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.860137 3986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "3217744321ab46c2ba09e90d7e895653"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "ec8b4e77b0b5ed481d667ccdd0412b31"
server_key_iv: "fb72370c84551af31b21582ae5a80067"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.863574 3986 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:30:45.866205 4000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.867444 3986 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:45.867558 3986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "3217744321ab46c2ba09e90d7e895653"
format_stamp: "Formatted at 2026-08-08 08:30:45 on dist-test-slave-zkpd"
server_key: "ec8b4e77b0b5ed481d667ccdd0412b31"
server_key_iv: "fb72370c84551af31b21582ae5a80067"
server_key_version: "encryptionkey@0"
I20260808 08:30:45.867669 3986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:45.871989 3986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:45.872566 3986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:45.872747 3986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:45.873273 3986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:45.874161 3986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:45.874229 3986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.874292 3986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:45.874330 3986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:45.882977 3986 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:43277
I20260808 08:30:45.882999 4115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:43277 every 8 connection(s)
I20260808 08:30:45.883800 3986 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:30:45.887826 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 3986
I20260808 08:30:45.887989 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:45.888288 26280 external_mini_cluster.cc:1428] Setting key c6a1645d9a9fc762374c56e7fa6b011b
I20260808 08:30:45.889819 3965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:45.885548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:38479 (local address 127.25.170.62:39033)
0808 08:30:45.885683 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:45.885686 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:45.886687 (+ 1001us) server_negotiation.cc:407] Connection header received
0808 08:30:45.888030 (+ 1343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:45.888033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:45.888079 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:45.888189 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:45.889317 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:45.889321 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:45.889324 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:45.889336 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:45.889365 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:45.889374 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:45.889468 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:45.889625 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 08:30:45.889671 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:30:45.890300 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39033
--builtin_ntp_servers=127.25.170.20:43249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 08:30:45.890674 4118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:45.885927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39033 (local address 127.25.170.1:38479)
0808 08:30:45.886548 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:45.886585 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:45.887799 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:45.888352 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:45.888380 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:45.888482 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:45.889059 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:45.889061 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:45.889107 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:45.889173 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:45.889456 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:45.889465 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:45.889472 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:30:45.889653 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 08:30:45.889879 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":108,"threads_started":1}
I20260808 08:30:45.891876 4116 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39033
I20260808 08:30:45.892165 4116 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:45.892638 4116 heartbeater.cc:511] Master 127.25.170.62:39033 requested a full tablet report, sending...
I20260808 08:30:45.894117 3925 ts_manager.cc:194] Registered new tserver with Master: 3217744321ab46c2ba09e90d7e895653 (127.25.170.1:43277)
W20260808 08:30:46.003108 4119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:46.003357 4119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:46.003396 4119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:46.007404 4119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:46.007455 4119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:46.007551 4119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:46.012200 4119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:43249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:46.013197 4119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:46.014546 4119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:46.023855 4124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:46.023877 4125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:46.024148 4119 server_base.cc:1034] running on GCE node
W20260808 08:30:46.023960 4128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:46.024663 4119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:46.025269 4119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:46.026463 4119 hybrid_clock.cc:648] HybridClock initialized: now 1786177846026432 us; error 41 us; skew 500 ppm
I20260808 08:30:46.028347 4119 webserver.cc:460] Webserver started at http://127.25.170.2:44377/ using document root <none> and password file <none>
I20260808 08:30:46.028905 4119 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:46.028999 4119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:46.029228 4119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:46.031214 4119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "2b57fee65b444799b5799bddafb22fa6"
format_stamp: "Formatted at 2026-08-08 08:30:46 on dist-test-slave-zkpd"
server_key: "18f8c065433f26885f4aeb9608fb4fe2"
server_key_iv: "c0ab0c16d9a0e5467635f4e3761c14e7"
server_key_version: "encryptionkey@0"
I20260808 08:30:46.031795 4119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "2b57fee65b444799b5799bddafb22fa6"
format_stamp: "Formatted at 2026-08-08 08:30:46 on dist-test-slave-zkpd"
server_key: "18f8c065433f26885f4aeb9608fb4fe2"
server_key_iv: "c0ab0c16d9a0e5467635f4e3761c14e7"
server_key_version: "encryptionkey@0"
I20260808 08:30:46.035578 4119 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:30:46.038084 4134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:46.039248 4119 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:46.039415 4119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "2b57fee65b444799b5799bddafb22fa6"
format_stamp: "Formatted at 2026-08-08 08:30:46 on dist-test-slave-zkpd"
server_key: "18f8c065433f26885f4aeb9608fb4fe2"
server_key_iv: "c0ab0c16d9a0e5467635f4e3761c14e7"
server_key_version: "encryptionkey@0"
I20260808 08:30:46.039529 4119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:46.044065 4119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:46.044636 4119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:46.044816 4119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:46.045337 4119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:46.046207 4119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:46.046275 4119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:46.046339 4119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:46.046388 4119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:46.055675 4119 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:45441
I20260808 08:30:46.055763 4248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:45441 every 8 connection(s)
I20260808 08:30:46.056883 4119 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:46.057148 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 4119
I20260808 08:30:46.057463 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:46.057766 26280 external_mini_cluster.cc:1428] Setting key 32d2ea4f69150ca27560c1bc22d165c8
I20260808 08:30:46.060020 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39033
--builtin_ntp_servers=127.25.170.20:43249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 08:30:46.063472 3965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:46.058874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:43567 (local address 127.25.170.62:39033)
0808 08:30:46.059018 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:46.059022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:46.060330 (+ 1308us) server_negotiation.cc:407] Connection header received
0808 08:30:46.061688 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:46.061691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:46.061732 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:46.061810 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:46.062916 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:46.062922 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:46.062928 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:46.062944 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:46.062969 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:46.062981 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:46.063070 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:46.063228 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 08:30:46.063275 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:30:46.064321 4251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:46.059384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39033 (local address 127.25.170.2:43567)
0808 08:30:46.060188 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:46.060243 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:46.061488 (+ 1245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:46.061972 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:46.061978 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:46.062061 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:46.062659 (+ 598us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:46.062661 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:46.062698 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:46.062763 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:46.063077 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:46.063085 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:46.063091 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 08:30:46.063239 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 08:30:46.063429 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":132,"threads_started":1}
I20260808 08:30:46.065553 4249 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39033
I20260808 08:30:46.065809 4249 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:46.066296 4249 heartbeater.cc:511] Master 127.25.170.62:39033 requested a full tablet report, sending...
I20260808 08:30:46.067478 3925 ts_manager.cc:194] Registered new tserver with Master: 2b57fee65b444799b5799bddafb22fa6 (127.25.170.2:45441)
W20260808 08:30:46.173982 4252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:46.174258 4252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:46.174333 4252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:46.178339 4252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:46.178416 4252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:46.178495 4252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:46.183197 4252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:43249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:46.184314 4252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:46.185675 4252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:46.195027 4258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:46.195075 4259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:46.195037 4261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:46.195262 4252 server_base.cc:1034] running on GCE node
I20260808 08:30:46.195734 4252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:46.196390 4252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:46.197578 4252 hybrid_clock.cc:648] HybridClock initialized: now 1786177846197564 us; error 27 us; skew 500 ppm
I20260808 08:30:46.199415 4252 webserver.cc:460] Webserver started at http://127.25.170.3:42655/ using document root <none> and password file <none>
I20260808 08:30:46.200191 4252 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:46.200271 4252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:46.200497 4252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:46.202543 4252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "d4ee44d571c94552937feebb61f502d0"
format_stamp: "Formatted at 2026-08-08 08:30:46 on dist-test-slave-zkpd"
server_key: "7d9675704f3b811bab7a2830134ee910"
server_key_iv: "2d0237cff9e255570baf3ad3a9f6a395"
server_key_version: "encryptionkey@0"
I20260808 08:30:46.203115 4252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "d4ee44d571c94552937feebb61f502d0"
format_stamp: "Formatted at 2026-08-08 08:30:46 on dist-test-slave-zkpd"
server_key: "7d9675704f3b811bab7a2830134ee910"
server_key_iv: "2d0237cff9e255570baf3ad3a9f6a395"
server_key_version: "encryptionkey@0"
I20260808 08:30:46.206749 4252 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 08:30:46.209326 4267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:46.210476 4252 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:30:46.210609 4252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "d4ee44d571c94552937feebb61f502d0"
format_stamp: "Formatted at 2026-08-08 08:30:46 on dist-test-slave-zkpd"
server_key: "7d9675704f3b811bab7a2830134ee910"
server_key_iv: "2d0237cff9e255570baf3ad3a9f6a395"
server_key_version: "encryptionkey@0"
I20260808 08:30:46.210719 4252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:46.215157 4252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:46.215723 4252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:46.215946 4252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:46.216470 4252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:46.217406 4252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:46.217474 4252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:46.217538 4252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:46.217584 4252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:46.226325 4252 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:35971
I20260808 08:30:46.226352 4380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:35971 every 8 connection(s)
I20260808 08:30:46.227221 4252 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:46.232985 3965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:46.229019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:50769 (local address 127.25.170.62:39033)
0808 08:30:46.229184 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:46.229189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:46.230175 (+ 986us) server_negotiation.cc:407] Connection header received
0808 08:30:46.231404 (+ 1229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:46.231406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:46.231443 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:46.231517 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:46.232603 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:46.232605 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:46.232607 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:30:46.232619 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:46.232640 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:30:46.232648 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:46.232720 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:46.232844 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 08:30:46.232881 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:30:46.233841 4383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:46.229414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39033 (local address 127.25.170.3:50769)
0808 08:30:46.230037 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:46.230075 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:46.231212 (+ 1137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:46.231675 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:46.231681 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:46.231803 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:46.232365 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:30:46.232367 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:46.232404 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:30:46.232468 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:46.232720 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:46.232727 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:46.232731 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:30:46.232857 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 08:30:46.233058 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":101,"threads_started":1}
I20260808 08:30:46.234941 4381 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39033
I20260808 08:30:46.235159 4381 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:46.235544 4381 heartbeater.cc:511] Master 127.25.170.62:39033 requested a full tablet report, sending...
I20260808 08:30:46.236570 3925 ts_manager.cc:194] Registered new tserver with Master: d4ee44d571c94552937feebb61f502d0 (127.25.170.3:35971)
I20260808 08:30:46.237294 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 4252
I20260808 08:30:46.237401 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:46.237703 26280 external_mini_cluster.cc:1428] Setting key 57bc5f5a6511ab318150021a3964c33a
I20260808 08:30:46.239627 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:30:46.242516 3965 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:30:46.241704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56160 (local address 127.25.170.62:39033)
0808 08:30:46.241842 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:46.241847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:46.241995 (+ 148us) server_negotiation.cc:407] Connection header received
0808 08:30:46.242087 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:46.242089 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:46.242117 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:46.242178 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:46.242396 (+ 218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56160: BlockingRecv error: recv got EOF from 127.0.0.1:56160 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:30:46.242631 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 3986
I20260808 08:30:46.254431 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 4119
I20260808 08:30:46.261852 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 4252
I20260808 08:30:46.268648 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 3893
2026-08-08T08:30:46Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (815 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:46 dist-test-slave-zkpd krb5kdc[4391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:46 dist-test-slave-zkpd krb5kdc[4391](info): set up 2 sockets
Aug 08 08:30:46 dist-test-slave-zkpd krb5kdc[4391](info): commencing operation
krb5kdc: starting...
W20260808 08:30:47.319106 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:47 dist-test-slave-zkpd krb5kdc[4391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:30:47.446230 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33033
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:38775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:33033
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:47.561846 4404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:47.562091 4404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:47.562129 4404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:47.566071 4404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:30:47.566124 4404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:47.566143 4404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:47.566159 4404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:30:47.566215 4404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:30:47.571300 4404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:33033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:47.572335 4404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:47.573343 4404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:30:47.581773 4404 server_base.cc:1034] running on GCE node
W20260808 08:30:47.581911 4410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:47.581948 4413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:47.581943 4411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:47.582527 4404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:47.583483 4404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:47.584638 4404 hybrid_clock.cc:648] HybridClock initialized: now 1786177847584604 us; error 44 us; skew 500 ppm
Aug 08 08:30:47 dist-test-slave-zkpd krb5kdc[4391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177847, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:47.591786 4404 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:30:47.592689 4404 webserver.cc:460] Webserver started at http://127.25.170.62:34227/ using document root <none> and password file <none>
I20260808 08:30:47.593243 4404 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:47.593335 4404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:47.593565 4404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:47.595577 4404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "120281bf788b47a78d9a0c19937aa09e"
format_stamp: "Formatted at 2026-08-08 08:30:47 on dist-test-slave-zkpd"
server_key: "8fa0c9e3333b8dec710d5cb78ce2c83b"
server_key_iv: "73be9978a61b5c375d9469762d37a7fa"
server_key_version: "encryptionkey@0"
I20260808 08:30:47.596168 4404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "120281bf788b47a78d9a0c19937aa09e"
format_stamp: "Formatted at 2026-08-08 08:30:47 on dist-test-slave-zkpd"
server_key: "8fa0c9e3333b8dec710d5cb78ce2c83b"
server_key_iv: "73be9978a61b5c375d9469762d37a7fa"
server_key_version: "encryptionkey@0"
I20260808 08:30:47.599638 4404 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:30:47.601989 4420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:47.603137 4404 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:47.603278 4404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "120281bf788b47a78d9a0c19937aa09e"
format_stamp: "Formatted at 2026-08-08 08:30:47 on dist-test-slave-zkpd"
server_key: "8fa0c9e3333b8dec710d5cb78ce2c83b"
server_key_iv: "73be9978a61b5c375d9469762d37a7fa"
server_key_version: "encryptionkey@0"
I20260808 08:30:47.603386 4404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:47.617009 4404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:47.620412 4404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:47.620626 4404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:47.628526 4404 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:33033
I20260808 08:30:47.628607 4474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:33033 every 8 connection(s)
I20260808 08:30:47.629482 4404 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:30:47.632788 4475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:47.634289 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 4404
I20260808 08:30:47.634415 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:30:47.634706 26280 external_mini_cluster.cc:1428] Setting key a58ae3c91911a7c65b27769da6c8e211
I20260808 08:30:47.638890 4475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e: Bootstrap starting.
I20260808 08:30:47.641099 4475 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:47.641844 4475 log.cc:824] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:30:47 dist-test-slave-zkpd krb5kdc[4391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:47.644101 4475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e: No bootstrap required, opened a new log
I20260808 08:30:47.647943 4475 raft_consensus.cc:348] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120281bf788b47a78d9a0c19937aa09e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33033 } }
I20260808 08:30:47.648173 4475 raft_consensus.cc:374] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:47.648249 4475 raft_consensus.cc:729] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 120281bf788b47a78d9a0c19937aa09e, State: Initialized, Role: FOLLOWER
I20260808 08:30:47.648666 4475 consensus_queue.cc:260] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120281bf788b47a78d9a0c19937aa09e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33033 } }
I20260808 08:30:47.648783 4475 raft_consensus.cc:388] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:30:47.648876 4475 raft_consensus.cc:482] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:30:47.648985 4475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:47.649127 4478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:47.636181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41400 (local address 127.25.170.62:33033)
0808 08:30:47.636620 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:47.636635 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:47.636670 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:30:47.637292 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:47.637309 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:47.637615 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:47.637948 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:47.638727 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:47.639752 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:47.640631 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:47.641091 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:47.641265 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:47.644281 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:47.644286 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:47.644298 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:47.644324 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:47.646068 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:47.646566 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:47.646570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:47.646574 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:47.646678 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:47.646966 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:47.646968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:47.646969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:47.647323 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:47.647481 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:47.647748 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 08:30:47.648106 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":141,"threads_started":1}
I20260808 08:30:47.649899 4475 raft_consensus.cc:504] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120281bf788b47a78d9a0c19937aa09e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33033 } }
I20260808 08:30:47.650234 4475 leader_election.cc:302] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 120281bf788b47a78d9a0c19937aa09e; no voters:
I20260808 08:30:47.650532 4475 leader_election.cc:288] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:30:47.650643 4480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:47.650851 4480 raft_consensus.cc:686] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [term 1 LEADER]: Becoming Leader. State: Replica: 120281bf788b47a78d9a0c19937aa09e, State: Running, Role: LEADER
I20260808 08:30:47.651293 4480 consensus_queue.cc:237] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120281bf788b47a78d9a0c19937aa09e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33033 } }
I20260808 08:30:47.651942 4475 sys_catalog.cc:564] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:30:47.653156 4482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 120281bf788b47a78d9a0c19937aa09e. Latest consensus state: current_term: 1 leader_uuid: "120281bf788b47a78d9a0c19937aa09e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120281bf788b47a78d9a0c19937aa09e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33033 } } }
I20260808 08:30:47.653156 4481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "120281bf788b47a78d9a0c19937aa09e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120281bf788b47a78d9a0c19937aa09e" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33033 } } }
I20260808 08:30:47.653386 4482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:47.653406 4481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e [sys.catalog]: This master's current role is: LEADER
I20260808 08:30:47.654294 4491 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:30:47.656869 4491 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:30:47.661746 4491 catalog_manager.cc:1347] Generated new cluster ID: 298018a032dc436e831723e7714c180a
I20260808 08:30:47.661814 4491 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:30:47.668540 4491 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:30:47.669342 4491 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:30:47.677670 4491 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e: Generated new TSK 0
I20260808 08:30:47.678262 4491 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:30:47.711230 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33033
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:38775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:47.822417 4501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:47.822695 4501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:47.822770 4501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:47.826771 4501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:47.826853 4501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:47.826934 4501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:30:47.832065 4501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:47.833039 4501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:47.834048 4501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:47.843444 4509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:47.843441 4507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:47.843500 4501 server_base.cc:1034] running on GCE node
W20260808 08:30:47.843449 4506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:47.844072 4501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:47.844671 4501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:47.845854 4501 hybrid_clock.cc:648] HybridClock initialized: now 1786177847845843 us; error 23 us; skew 500 ppm
Aug 08 08:30:47 dist-test-slave-zkpd krb5kdc[4391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177847, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:47.848533 4501 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:30:47.849326 4501 webserver.cc:460] Webserver started at http://127.25.170.1:45103/ using document root <none> and password file <none>
I20260808 08:30:47.849854 4501 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:47.849953 4501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:47.850176 4501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:47.852437 4501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "fabdc491896d4d07b1c572fe2e5c8773"
format_stamp: "Formatted at 2026-08-08 08:30:47 on dist-test-slave-zkpd"
server_key: "89daf252f13cd19786b070d71477d2a1"
server_key_iv: "da56a03c7a86422368c17334cbdb2d28"
server_key_version: "encryptionkey@0"
I20260808 08:30:47.853037 4501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "fabdc491896d4d07b1c572fe2e5c8773"
format_stamp: "Formatted at 2026-08-08 08:30:47 on dist-test-slave-zkpd"
server_key: "89daf252f13cd19786b070d71477d2a1"
server_key_iv: "da56a03c7a86422368c17334cbdb2d28"
server_key_version: "encryptionkey@0"
I20260808 08:30:47.856680 4501 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:30:47.858956 4516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:47.860163 4501 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:30:47.860293 4501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "fabdc491896d4d07b1c572fe2e5c8773"
format_stamp: "Formatted at 2026-08-08 08:30:47 on dist-test-slave-zkpd"
server_key: "89daf252f13cd19786b070d71477d2a1"
server_key_iv: "da56a03c7a86422368c17334cbdb2d28"
server_key_version: "encryptionkey@0"
I20260808 08:30:47.860400 4501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:47.873345 4501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:47.876014 4501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:47.876200 4501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:47.876748 4501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:47.877539 4501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:47.877609 4501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:47.877678 4501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:47.877730 4501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:47.886581 4501 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:46375
I20260808 08:30:47.886618 4636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:46375 every 8 connection(s)
I20260808 08:30:47.887418 4501 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
Aug 08 08:30:47 dist-test-slave-zkpd krb5kdc[4391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177847, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:47.897567 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 4501
I20260808 08:30:47.897701 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:30:47.898046 26280 external_mini_cluster.cc:1428] Setting key a3f0d878db16fbbdac9a5afd3e5df88b
I20260808 08:30:47.900943 4478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:47.889109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:44873 (local address 127.25.170.62:33033)
0808 08:30:47.889242 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:47.889250 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:47.889984 (+ 734us) server_negotiation.cc:407] Connection header received
0808 08:30:47.891418 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:47.891422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:47.891480 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:47.891587 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:47.892773 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:47.893319 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:47.894467 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:47.894704 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:47.894815 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:47.897218 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:47.897228 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:47.897231 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:47.897255 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:47.898834 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:47.899383 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:47.899385 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:47.899387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:47.899463 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:47.899832 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:47.899836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:47.899837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:47.900071 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:47.900181 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:47.900645 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 08:30:47.900766 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:30:47.901714 4639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:47.889401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33033 (local address 127.25.170.1:44873)
0808 08:30:47.889835 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:47.889877 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:47.891207 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:47.891766 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:47.891778 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:47.892186 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:47.892628 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:47.892641 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:47.893452 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:47.893455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:47.894327 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:47.894337 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:47.894857 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:47.894861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:47.895041 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:47.895610 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:47.895626 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:47.897057 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:47.898951 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:47.898957 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:47.898970 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:47.899252 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:47.899567 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:47.899571 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:47.899573 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:47.899723 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:47.900181 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:47.900188 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:47.900417 (+ 229us) client_negotiation.cc:769] Sending connection context
0808 08:30:47.900601 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 08:30:47.900910 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":108,"threads_started":1}
I20260808 08:30:47.902880 4637 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33033
I20260808 08:30:47.903138 4637 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:47.903584 4637 heartbeater.cc:511] Master 127.25.170.62:33033 requested a full tablet report, sending...
I20260808 08:30:47.905076 4437 ts_manager.cc:194] Registered new tserver with Master: fabdc491896d4d07b1c572fe2e5c8773 (127.25.170.1:46375)
I20260808 08:30:47.906414 4437 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:44873
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:30:47.924959 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33033
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:38775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:48.039688 4642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:48.040047 4642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:48.040132 4642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:48.043998 4642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:48.044050 4642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:48.044140 4642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:30:48.049054 4642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:48.049964 4642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:48.050932 4642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:48.060240 4649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:48.060256 4648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:48.060236 4651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:48.060701 4642 server_base.cc:1034] running on GCE node
I20260808 08:30:48.061079 4642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:48.061698 4642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:48.062909 4642 hybrid_clock.cc:648] HybridClock initialized: now 1786177848062852 us; error 71 us; skew 500 ppm
Aug 08 08:30:48 dist-test-slave-zkpd krb5kdc[4391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177848, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:48.066167 4642 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:30:48.066957 4642 webserver.cc:460] Webserver started at http://127.25.170.2:45367/ using document root <none> and password file <none>
I20260808 08:30:48.067446 4642 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:48.067504 4642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:48.067669 4642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:48.069661 4642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "fe6eab44271d410b8ec95c24d074e426"
format_stamp: "Formatted at 2026-08-08 08:30:48 on dist-test-slave-zkpd"
server_key: "2fa7551d4a669d19dd28056e54761f98"
server_key_iv: "b4ee4312e1ccbfca20b8ef8471e91eda"
server_key_version: "encryptionkey@0"
I20260808 08:30:48.070163 4642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "fe6eab44271d410b8ec95c24d074e426"
format_stamp: "Formatted at 2026-08-08 08:30:48 on dist-test-slave-zkpd"
server_key: "2fa7551d4a669d19dd28056e54761f98"
server_key_iv: "b4ee4312e1ccbfca20b8ef8471e91eda"
server_key_version: "encryptionkey@0"
I20260808 08:30:48.073693 4642 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:30:48.075954 4658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:48.077080 4642 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:30:48.077179 4642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "fe6eab44271d410b8ec95c24d074e426"
format_stamp: "Formatted at 2026-08-08 08:30:48 on dist-test-slave-zkpd"
server_key: "2fa7551d4a669d19dd28056e54761f98"
server_key_iv: "b4ee4312e1ccbfca20b8ef8471e91eda"
server_key_version: "encryptionkey@0"
I20260808 08:30:48.077255 4642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:48.093111 4642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:48.096261 4642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:48.096417 4642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:48.096916 4642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:48.097646 4642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:48.097690 4642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:48.097728 4642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:48.097744 4642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:48.106498 4642 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:38665
I20260808 08:30:48.106573 4775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:38665 every 8 connection(s)
I20260808 08:30:48.107445 4642 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:30:48.111030 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 4642
I20260808 08:30:48.111162 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:30:48.111431 26280 external_mini_cluster.cc:1428] Setting key 058d7f37604cb733f7022f447e5c35b2
Aug 08 08:30:48 dist-test-slave-zkpd krb5kdc[4391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177848, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:48.121266 4478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.109278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:41349 (local address 127.25.170.62:33033)
0808 08:30:48.109418 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:48.109422 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:48.110165 (+ 743us) server_negotiation.cc:407] Connection header received
0808 08:30:48.111693 (+ 1528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:48.111697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:48.111761 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:48.111873 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:48.113052 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.113595 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.114760 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.115003 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.115119 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.117582 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:48.117586 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:48.117589 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:48.117621 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:48.119139 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:48.119655 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:48.119662 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:48.119664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:48.119749 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:48.120137 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:48.120141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:48.120143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:48.120342 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:48.120452 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:48.120963 (+ 511us) server_negotiation.cc:299] Negotiation successful
0808 08:30:48.121092 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:30:48.122047 4778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.109584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33033 (local address 127.25.170.2:41349)
0808 08:30:48.110021 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:48.110062 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:48.111453 (+ 1391us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:48.112079 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:48.112086 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:48.112449 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:48.112909 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.112922 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.113738 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.113741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.114629 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.114639 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.115162 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.115166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.115343 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.115994 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:48.116011 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:48.117418 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:48.119262 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:48.119267 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:48.119283 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:48.119548 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:48.119854 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:48.119858 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:48.119860 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:48.120036 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:48.120451 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:48.120458 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:48.120714 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 08:30:48.120897 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 08:30:48.121219 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":113,"threads_started":1}
I20260808 08:30:48.123250 4776 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33033
I20260808 08:30:48.123507 4776 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:48.124061 4776 heartbeater.cc:511] Master 127.25.170.62:33033 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
I20260808 08:30:48.125216 4437 ts_manager.cc:194] Registered new tserver with Master: fe6eab44271d410b8ec95c24d074e426 (127.25.170.2:38665)
I20260808 08:30:48.126067 4437 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:41349
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:30:48.140635 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33033
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:38775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:30:48.252918 4781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:30:48.253170 4781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:30:48.253274 4781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:30:48.257364 4781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:30:48.257457 4781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:30:48.257539 4781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:30:48.262820 4781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:30:48.263767 4781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:30:48.264801 4781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:30:48.274405 4787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:48.274435 4789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:30:48.274444 4786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:30:48.274503 4781 server_base.cc:1034] running on GCE node
I20260808 08:30:48.275072 4781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:30:48.275668 4781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:30:48.276855 4781 hybrid_clock.cc:648] HybridClock initialized: now 1786177848276821 us; error 55 us; skew 500 ppm
Aug 08 08:30:48 dist-test-slave-zkpd krb5kdc[4391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177848, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:30:48.279546 4781 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:30:48.280472 4781 webserver.cc:460] Webserver started at http://127.25.170.3:38249/ using document root <none> and password file <none>
I20260808 08:30:48.281044 4781 fs_manager.cc:359] Metadata directory not provided
I20260808 08:30:48.281132 4781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:30:48.281345 4781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:30:48.283290 4781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "36a28f94526d4c3ba1d908e2d59458aa"
format_stamp: "Formatted at 2026-08-08 08:30:48 on dist-test-slave-zkpd"
server_key: "e7469cbc0522367f1f6decdcfb58d49b"
server_key_iv: "6a13b6d64f333f188d85a03c0e97334e"
server_key_version: "encryptionkey@0"
I20260808 08:30:48.283852 4781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "36a28f94526d4c3ba1d908e2d59458aa"
format_stamp: "Formatted at 2026-08-08 08:30:48 on dist-test-slave-zkpd"
server_key: "e7469cbc0522367f1f6decdcfb58d49b"
server_key_iv: "6a13b6d64f333f188d85a03c0e97334e"
server_key_version: "encryptionkey@0"
I20260808 08:30:48.287472 4781 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:30:48.289945 4796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:48.291115 4781 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:30:48.291256 4781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "36a28f94526d4c3ba1d908e2d59458aa"
format_stamp: "Formatted at 2026-08-08 08:30:48 on dist-test-slave-zkpd"
server_key: "e7469cbc0522367f1f6decdcfb58d49b"
server_key_iv: "6a13b6d64f333f188d85a03c0e97334e"
server_key_version: "encryptionkey@0"
I20260808 08:30:48.291366 4781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:30:48.305032 4781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:30:48.308313 4781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:30:48.308506 4781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:30:48.309098 4781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:30:48.309917 4781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:30:48.309989 4781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:48.310060 4781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:30:48.310111 4781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:30:48.319190 4781 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:46491
I20260808 08:30:48.319223 4914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:46491 every 8 connection(s)
I20260808 08:30:48.320093 4781 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:30:48.327046 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 4781
I20260808 08:30:48.327162 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:30:48.327489 26280 external_mini_cluster.cc:1428] Setting key cd6cb6962f081c553547c6f6d172feb1
Aug 08 08:30:48 dist-test-slave-zkpd krb5kdc[4391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177848, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:30:48.332854 4478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.321771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:37215 (local address 127.25.170.62:33033)
0808 08:30:48.321935 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:48.321939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:48.322718 (+ 779us) server_negotiation.cc:407] Connection header received
0808 08:30:48.324098 (+ 1380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:48.324100 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:48.324147 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:48.324220 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:48.325298 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.325816 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.326934 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.327271 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.327386 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.329884 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:48.329886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:48.329888 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:48.329912 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:48.331115 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:48.331553 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:48.331556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:48.331557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:48.331630 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:48.331966 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:48.331969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:48.331971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:48.332147 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:48.332224 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:48.332647 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 08:30:48.332738 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:30:48.333572 4917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.322142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33033 (local address 127.25.170.3:37215)
0808 08:30:48.322570 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:48.322610 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:48.323842 (+ 1232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:48.324377 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:48.324384 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:48.324711 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:30:48.325176 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.325189 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.325923 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.325926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.326793 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.326828 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.327413 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.327416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.327553 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.328220 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:30:48.328235 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:30:48.329731 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:30:48.331216 (+ 1485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:48.331221 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:48.331231 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:48.331470 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:48.331708 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:30:48.331710 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:30:48.331712 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:30:48.331842 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:30:48.332237 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:30:48.332241 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:30:48.332447 (+ 206us) client_negotiation.cc:769] Sending connection context
0808 08:30:48.332587 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 08:30:48.332821 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":113,"threads_started":1}
I20260808 08:30:48.334672 4915 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33033
I20260808 08:30:48.334877 4915 heartbeater.cc:464] Registering TS with master...
I20260808 08:30:48.335276 4915 heartbeater.cc:511] Master 127.25.170.62:33033 requested a full tablet report, sending...
I20260808 08:30:48.336228 4437 ts_manager.cc:194] Registered new tserver with Master: 36a28f94526d4c3ba1d908e2d59458aa (127.25.170.3:46491)
I20260808 08:30:48.336751 4437 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:37215
I20260808 08:30:48.341109 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:30:48.349277 4478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.342907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41410 (local address 127.25.170.62:33033)
0808 08:30:48.343019 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:48.343022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:48.343210 (+ 188us) server_negotiation.cc:407] Connection header received
0808 08:30:48.343303 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:48.343305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:48.343339 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:48.343401 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:30:48.344044 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.344505 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.345280 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.345473 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.345543 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.346673 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:30:48.346676 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:30:48.346677 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:30:48.346698 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:30:48.347936 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:48.348305 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:48.348307 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:48.348308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:48.348378 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:30:48.348599 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:30:48.348601 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:30:48.348602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:30:48.348797 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:30:48.348901 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:48.349087 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 08:30:48.349172 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:30:48.352182 4437 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:30:48.355679 4437 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:30:48.369757 4930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.363658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:38665 (local address 127.0.0.1:50656)
0808 08:30:48.364572 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:48.364618 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:48.364744 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:48.365437 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:48.365443 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:48.365464 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:48.365595 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.365604 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.367056 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.367060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.368390 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.368397 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.369222 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.369226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.369333 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.369370 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:30:48.369482 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 08:30:48.369602 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":117,"spinlock_wait_cycles":7424,"thread_start_us":107,"threads_started":1}
I20260808 08:30:48.369763 4929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.363860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50656 (local address 127.25.170.2:38665)
0808 08:30:48.364345 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:48.364359 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:48.364704 (+ 345us) server_negotiation.cc:407] Connection header received
0808 08:30:48.365074 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:48.365081 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:48.365280 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:48.365443 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:48.365731 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.366918 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.368534 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.369092 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.369221 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.369385 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:48.369510 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 08:30:48.369602 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":131,"threads_started":1}
I20260808 08:30:48.370138 4928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.364102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:46375 (local address 127.0.0.1:56846)
0808 08:30:48.365002 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:48.365014 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:48.365098 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:48.365723 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:48.365726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:48.365743 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:48.365878 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.365884 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.367265 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.367269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.368264 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.368275 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.369569 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.369573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.369796 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.369851 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 08:30:48.369922 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 08:30:48.370010 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"mutex_wait_us":107,"thread_start_us":85,"threads_started":1}
I20260808 08:30:48.370263 4932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.364554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51044 (local address 127.25.170.3:46491)
0808 08:30:48.365222 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:48.365232 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:48.365250 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:30:48.365322 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:48.365326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:48.365478 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:48.365647 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:48.365916 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.366683 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.368513 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.369292 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.369385 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.369502 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:48.370011 (+ 509us) server_negotiation.cc:299] Negotiation successful
0808 08:30:48.370104 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":113,"threads_started":1}
I20260808 08:30:48.370586 4926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.363668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:46491 (local address 127.0.0.1:51044)
0808 08:30:48.364570 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:48.364618 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:48.364983 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:48.365654 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:48.365659 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:48.365680 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:48.365791 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.365796 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.366826 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.366830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.368386 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.368397 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.369569 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.369573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.369740 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.369854 (+ 114us) client_negotiation.cc:769] Sending connection context
0808 08:30:48.369923 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 08:30:48.370453 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"mutex_wait_us":559,"thread_start_us":86,"threads_started":1}
I20260808 08:30:48.370841 4931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.364174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56846 (local address 127.25.170.1:46375)
0808 08:30:48.365086 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:48.365102 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:48.365125 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:30:48.365202 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:48.365207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:48.365400 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:48.365552 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:48.366007 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.367117 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.368390 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.369221 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.369363 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.369502 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:48.370583 (+ 1081us) server_negotiation.cc:299] Negotiation successful
0808 08:30:48.370687 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":798,"thread_start_us":94,"threads_started":1}
I20260808 08:30:48.373389 4846 tablet_service.cc:1467] Processing CreateTablet for tablet d4522455d7e64f5c8e4e0fd69e7b9fa4 (DEFAULT_TABLE table=test-table [id=c88b8ea4cfc3452093e3fa5b3a424d71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:48.373342 4708 tablet_service.cc:1467] Processing CreateTablet for tablet d4522455d7e64f5c8e4e0fd69e7b9fa4 (DEFAULT_TABLE table=test-table [id=c88b8ea4cfc3452093e3fa5b3a424d71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:48.374365 4846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4522455d7e64f5c8e4e0fd69e7b9fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:48.374395 4708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4522455d7e64f5c8e4e0fd69e7b9fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:48.374135 4565 tablet_service.cc:1467] Processing CreateTablet for tablet d4522455d7e64f5c8e4e0fd69e7b9fa4 (DEFAULT_TABLE table=test-table [id=c88b8ea4cfc3452093e3fa5b3a424d71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:30:48.375061 4565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4522455d7e64f5c8e4e0fd69e7b9fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:30:48.381129 4933 tablet_bootstrap.cc:492] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: Bootstrap starting.
I20260808 08:30:48.382416 4934 tablet_bootstrap.cc:492] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: Bootstrap starting.
I20260808 08:30:48.384068 4933 tablet_bootstrap.cc:654] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:48.384245 4935 tablet_bootstrap.cc:492] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773: Bootstrap starting.
I20260808 08:30:48.384987 4934 tablet_bootstrap.cc:654] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:48.385027 4933 log.cc:824] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:48.385890 4934 log.cc:824] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:48.386147 4935 tablet_bootstrap.cc:654] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773: Neither blocks nor log segments found. Creating new log.
I20260808 08:30:48.387347 4935 log.cc:824] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773: Log is configured to *not* fsync() on all Append() calls
I20260808 08:30:48.387406 4933 tablet_bootstrap.cc:492] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: No bootstrap required, opened a new log
I20260808 08:30:48.387588 4933 ts_tablet_manager.cc:1397] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:30:48.387673 4934 tablet_bootstrap.cc:492] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: No bootstrap required, opened a new log
I20260808 08:30:48.387885 4934 ts_tablet_manager.cc:1397] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:30:48.389359 4935 tablet_bootstrap.cc:492] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773: No bootstrap required, opened a new log
I20260808 08:30:48.389587 4935 ts_tablet_manager.cc:1397] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:30:48.390957 4934 raft_consensus.cc:348] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6eab44271d410b8ec95c24d074e426" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38665 } } peers { permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 } } peers { permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 } }
I20260808 08:30:48.391197 4934 raft_consensus.cc:374] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:48.391260 4934 raft_consensus.cc:729] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6eab44271d410b8ec95c24d074e426, State: Initialized, Role: FOLLOWER
I20260808 08:30:48.391711 4934 consensus_queue.cc:260] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6eab44271d410b8ec95c24d074e426" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38665 } } peers { permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 } } peers { permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 } }
I20260808 08:30:48.391607 4933 raft_consensus.cc:348] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6eab44271d410b8ec95c24d074e426" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38665 } } peers { permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 } } peers { permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 } }
I20260808 08:30:48.391852 4933 raft_consensus.cc:374] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:48.391947 4933 raft_consensus.cc:729] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a28f94526d4c3ba1d908e2d59458aa, State: Initialized, Role: FOLLOWER
I20260808 08:30:48.392396 4776 heartbeater.cc:503] Master 127.25.170.62:33033 was elected leader, sending a full tablet report...
I20260808 08:30:48.392367 4933 consensus_queue.cc:260] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6eab44271d410b8ec95c24d074e426" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38665 } } peers { permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 } } peers { permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 } }
I20260808 08:30:48.393365 4933 ts_tablet_manager.cc:1428] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:30:48.393728 4915 heartbeater.cc:503] Master 127.25.170.62:33033 was elected leader, sending a full tablet report...
I20260808 08:30:48.393607 4935 raft_consensus.cc:348] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6eab44271d410b8ec95c24d074e426" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38665 } } peers { permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 } } peers { permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 } }
I20260808 08:30:48.393895 4935 raft_consensus.cc:374] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:30:48.393955 4935 raft_consensus.cc:729] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabdc491896d4d07b1c572fe2e5c8773, State: Initialized, Role: FOLLOWER
I20260808 08:30:48.394389 4935 consensus_queue.cc:260] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6eab44271d410b8ec95c24d074e426" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38665 } } peers { permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 } } peers { permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 } }
I20260808 08:30:48.395035 4637 heartbeater.cc:503] Master 127.25.170.62:33033 was elected leader, sending a full tablet report...
I20260808 08:30:48.395990 4934 ts_tablet_manager.cc:1428] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:30:48.396044 4935 ts_tablet_manager.cc:1428] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:30:48.480142 4939 raft_consensus.cc:482] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:30:48.480412 4939 raft_consensus.cc:504] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6eab44271d410b8ec95c24d074e426" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38665 } } peers { permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 } } peers { permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 } }
I20260808 08:30:48.481724 4939 leader_election.cc:288] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36a28f94526d4c3ba1d908e2d59458aa (127.25.170.3:46491), fabdc491896d4d07b1c572fe2e5c8773 (127.25.170.1:46375)
I20260808 08:30:48.485879 4932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.482120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:40951 (local address 127.25.170.3:46491)
0808 08:30:48.482241 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:48.482245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:48.482259 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:30:48.482333 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:48.482336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:48.482385 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:48.482455 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:48.482871 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.483600 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.484857 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.485279 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.485378 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.485462 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:48.485658 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 08:30:48.485738 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:30:48.485883 4778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.481996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:46491 (local address 127.25.170.2:40951)
0808 08:30:48.482133 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:48.482148 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:48.482245 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:48.482555 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:48.482561 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:48.482588 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:48.482731 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.482738 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.483726 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.483730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.484704 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.484715 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.485406 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.485411 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.485517 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.485547 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 08:30:48.485617 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 08:30:48.485706 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":53}
I20260808 08:30:48.485903 4931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.482059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:42297 (local address 127.25.170.1:46375)
0808 08:30:48.482183 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:48.482189 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:48.482607 (+ 418us) server_negotiation.cc:407] Connection header received
0808 08:30:48.482760 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:48.482766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:48.482857 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:48.482941 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:30:48.483232 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.483832 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.484927 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.485314 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.485448 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.485505 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:48.485716 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 08:30:48.485797 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:30:48.485927 4942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.482009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:46375 (local address 127.25.170.2:42297)
0808 08:30:48.482505 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:48.482521 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:30:48.482647 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:30:48.482967 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:30:48.482970 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:30:48.482987 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:30:48.483112 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.483120 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.483988 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.483991 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.484784 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:30:48.484798 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.485464 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.485468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:30:48.485565 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.485583 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 08:30:48.485680 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 08:30:48.485745 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":116,"thread_start_us":159,"threads_started":1}
I20260808 08:30:48.486681 4587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4522455d7e64f5c8e4e0fd69e7b9fa4" candidate_uuid: "fe6eab44271d410b8ec95c24d074e426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabdc491896d4d07b1c572fe2e5c8773" is_pre_election: true
I20260808 08:30:48.486872 4866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4522455d7e64f5c8e4e0fd69e7b9fa4" candidate_uuid: "fe6eab44271d410b8ec95c24d074e426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a28f94526d4c3ba1d908e2d59458aa" is_pre_election: true
I20260808 08:30:48.486974 4587 raft_consensus.cc:2454] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6eab44271d410b8ec95c24d074e426 in term 0.
I20260808 08:30:48.487175 4866 raft_consensus.cc:2454] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6eab44271d410b8ec95c24d074e426 in term 0.
I20260808 08:30:48.487474 4660 leader_election.cc:302] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fabdc491896d4d07b1c572fe2e5c8773, fe6eab44271d410b8ec95c24d074e426; no voters:
I20260808 08:30:48.487753 4939 raft_consensus.cc:2781] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:30:48.487843 4939 raft_consensus.cc:482] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:30:48.487911 4939 raft_consensus.cc:3037] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:48.488945 4939 raft_consensus.cc:504] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6eab44271d410b8ec95c24d074e426" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38665 } } peers { permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 } } peers { permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 } }
I20260808 08:30:48.489243 4939 leader_election.cc:288] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [CANDIDATE]: Term 1 election: Requested vote from peers 36a28f94526d4c3ba1d908e2d59458aa (127.25.170.3:46491), fabdc491896d4d07b1c572fe2e5c8773 (127.25.170.1:46375)
I20260808 08:30:48.489565 4866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4522455d7e64f5c8e4e0fd69e7b9fa4" candidate_uuid: "fe6eab44271d410b8ec95c24d074e426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a28f94526d4c3ba1d908e2d59458aa"
I20260808 08:30:48.489602 4587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4522455d7e64f5c8e4e0fd69e7b9fa4" candidate_uuid: "fe6eab44271d410b8ec95c24d074e426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabdc491896d4d07b1c572fe2e5c8773"
I20260808 08:30:48.489663 4866 raft_consensus.cc:3037] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:48.489746 4587 raft_consensus.cc:3037] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:30:48.491183 4587 raft_consensus.cc:2454] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6eab44271d410b8ec95c24d074e426 in term 1.
I20260808 08:30:48.491210 4866 raft_consensus.cc:2454] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6eab44271d410b8ec95c24d074e426 in term 1.
I20260808 08:30:48.491496 4660 leader_election.cc:302] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fabdc491896d4d07b1c572fe2e5c8773, fe6eab44271d410b8ec95c24d074e426; no voters:
I20260808 08:30:48.491667 4939 raft_consensus.cc:2781] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:30:48.491937 4939 raft_consensus.cc:686] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 1 LEADER]: Becoming Leader. State: Replica: fe6eab44271d410b8ec95c24d074e426, State: Running, Role: LEADER
I20260808 08:30:48.492285 4939 consensus_queue.cc:237] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6eab44271d410b8ec95c24d074e426" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38665 } } peers { permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 } } peers { permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 } }
I20260808 08:30:48.495576 4436 catalog_manager.cc:5495] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6eab44271d410b8ec95c24d074e426 (127.25.170.2). New cstate: current_term: 1 leader_uuid: "fe6eab44271d410b8ec95c24d074e426" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe6eab44271d410b8ec95c24d074e426" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 } health_report { overall_health: UNKNOWN } } }
I20260808 08:30:48.520630 4929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.517466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50666 (local address 127.25.170.2:38665)
0808 08:30:48.517608 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 08:30:48.517611 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:30:48.517623 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:30:48.517696 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:30:48.517698 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:30:48.517752 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:30:48.517853 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:30:48.518068 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.518555 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.519334 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:30:48.519529 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:30:48.519601 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:30:48.519890 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:30:48.520307 (+ 417us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:30:48.520395 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 08:30:48.520459 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 08:30:48.520505 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:30:48.526336 4866 raft_consensus.cc:1261] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa [term 1 FOLLOWER]: Refusing update from remote peer fe6eab44271d410b8ec95c24d074e426: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:48.526337 4587 raft_consensus.cc:1261] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773 [term 1 FOLLOWER]: Refusing update from remote peer fe6eab44271d410b8ec95c24d074e426: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:30:48.527127 4944 consensus_queue.cc:1035] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a28f94526d4c3ba1d908e2d59458aa" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 46491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:48.527302 4939 consensus_queue.cc:1035] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabdc491896d4d07b1c572fe2e5c8773" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 46375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:30:48.534420 4947 mvcc.cc:205] Tried to move back new op lower bound from 7316184467556474880 to 7316184467426983936. Current Snapshot: MvccSnapshot[applied={T|T < 7316184467556474880}]
I20260808 08:30:48.542236 4950 mvcc.cc:205] Tried to move back new op lower bound from 7316184467556474880 to 7316184467426983936. Current Snapshot: MvccSnapshot[applied={T|T < 7316184467556474880}]
I20260808 08:30:48.543418 4436 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:48.543594 4436 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:30:48.546053 4436 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 120281bf788b47a78d9a0c19937aa09e: Sending DeleteTablet for 3 replicas of tablet d4522455d7e64f5c8e4e0fd69e7b9fa4
I20260808 08:30:48.546916 4708 tablet_service.cc:1514] Processing DeleteTablet for tablet d4522455d7e64f5c8e4e0fd69e7b9fa4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:48 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:50656
I20260808 08:30:48.546916 4565 tablet_service.cc:1514] Processing DeleteTablet for tablet d4522455d7e64f5c8e4e0fd69e7b9fa4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:48 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:56846
I20260808 08:30:48.547410 4958 tablet_replica.cc:330] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: stopping tablet replica
I20260808 08:30:48.547418 4846 tablet_service.cc:1514] Processing DeleteTablet for tablet d4522455d7e64f5c8e4e0fd69e7b9fa4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:30:48 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:51044
I20260808 08:30:48.547694 4957 tablet_replica.cc:330] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773: stopping tablet replica
I20260808 08:30:48.548069 4957 raft_consensus.cc:2229] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fabdc491896d4d07b1c572fe2e5c8773 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:48.548091 4959 tablet_replica.cc:330] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: stopping tablet replica
I20260808 08:30:48.548187 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 4501
I20260808 08:30:48.548435 4958 raft_consensus.cc:2229] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:30:48.548774 4958 raft_consensus.cc:2258] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:48.550377 4959 raft_consensus.cc:2229] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:30:48.550637 4958 ts_tablet_manager.cc:1905] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:48.550766 4959 raft_consensus.cc:2258] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:30:48.552712 4959 ts_tablet_manager.cc:1905] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:30:48.554272 4958 ts_tablet_manager.cc:1918] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:48.554423 4958 log.cc:1196] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/d4522455d7e64f5c8e4e0fd69e7b9fa4
I20260808 08:30:48.554863 4958 ts_tablet_manager.cc:1939] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P fe6eab44271d410b8ec95c24d074e426: Deleting consensus metadata
I20260808 08:30:48.556254 4959 ts_tablet_manager.cc:1918] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:30:48.556365 4959 log.cc:1196] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/d4522455d7e64f5c8e4e0fd69e7b9fa4
I20260808 08:30:48.556663 4424 catalog_manager.cc:4841] TS fe6eab44271d410b8ec95c24d074e426 (127.25.170.2:38665): tablet d4522455d7e64f5c8e4e0fd69e7b9fa4 (table test-table [id=c88b8ea4cfc3452093e3fa5b3a424d71]) successfully deleted
I20260808 08:30:48.556728 4959 ts_tablet_manager.cc:1939] T d4522455d7e64f5c8e4e0fd69e7b9fa4 P 36a28f94526d4c3ba1d908e2d59458aa: Deleting consensus metadata
I20260808 08:30:48.557857 4421 catalog_manager.cc:4841] TS 36a28f94526d4c3ba1d908e2d59458aa (127.25.170.3:46491): tablet d4522455d7e64f5c8e4e0fd69e7b9fa4 (table test-table [id=c88b8ea4cfc3452093e3fa5b3a424d71]) successfully deleted
W20260808 08:30:48.560415 4422 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:46375 (error 108)
I20260808 08:30:48.561197 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 4642
I20260808 08:30:48.561465 4928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:30:48.561163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:46375 (local address 127.0.0.1:56852)
0808 08:30:48.561298 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 08:30:48.561372 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:46375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 08:30:48.564241 4422 catalog_manager.cc:4584] TS fabdc491896d4d07b1c572fe2e5c8773 (127.25.170.1:46375): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d4522455d7e64f5c8e4e0fd69e7b9fa4: Network error: Client connection negotiation failed: client connection to 127.25.170.1:46375: connect: Connection refused (error 111)
I20260808 08:30:48.568581 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 4781
I20260808 08:30:48.575294 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 4404
2026-08-08T08:30:48Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2307 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:30:48 dist-test-slave-zkpd krb5kdc[4963](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:30:48 dist-test-slave-zkpd krb5kdc[4963](info): set up 2 sockets
Aug 08 08:30:48 dist-test-slave-zkpd krb5kdc[4963](info): commencing operation
krb5kdc: starting...
W20260808 08:30:49.658123 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:30:49 dist-test-slave-zkpd krb5kdc[4963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:30:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:30:49Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.25.170.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.25.170.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/rangeradmin_127.25.170.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/rangeradmin_127.25.170.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.25.170.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.25.170.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/rangerlookup_127.25.170.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/rangerlookup_127.25.170.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.170.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.25.170.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/HTTP_127.25.170.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/HTTP_127.25.170.20@KRBTEST.COM.keytab.
I20260808 08:30:49.828585 26280 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasklAkZqe/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/postgres -l logfile start
2026-08-08 08:30:52.208 UTC [4993] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 08:30:52.208 UTC [4993] LOG: listening on IPv4 address "127.25.170.20", port 54617
2026-08-08 08:30:52.211 UTC [4993] LOG: listening on Unix socket "/tmp/.s.PGSQL.54617"
2026-08-08 08:30:52.232 UTC [4996] LOG: database system was shut down at 2026-08-08 08:30:50 UTC
2026-08-08 08:30:52.235 UTC [4993] LOG: database system is ready to accept connections
I20260808 08:30:53.214246 26280 mini_postgres.cc:96] Postgres bound to 54617
2026-08-08 08:30:53.221 UTC [5005] FATAL: database "slave" does not exist
127.25.170.20:54617 - accepting connections
I20260808 08:30:53.222405 26280 mini_ranger.cc:161] Starting Ranger...
I20260808 08:30:53.237784 26280 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 08:30:53.680212 26280 mini_ranger.cc:87] Created ranger Postgres database
I20260808 08:30:53.680320 26280 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-admin
2026-08-08 08:30:53,960 [I] DB FLAVOR :POSTGRES
2026-08-08 08:30:53,960 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:30:53,961 [I] Checking connection..
2026-08-08 08:30:53,961 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 08:30:54,213 [I] Checking connection passed.
2026-08-08 08:30:54,213 [I] --------- Verifying version history table ---------
2026-08-08 08:30:54,213 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:30:54,478 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:30:54,479 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:30:54,742 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:30:54,742 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 08:30:54,742 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 08:30:54.999 UTC [5074] WARNING: there is no transaction in progress
2026-08-08 08:30:55,006 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 08:30:55,006 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:30:55,259 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 08:30:55,259 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:30:55,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 08:30:55,493 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 08:30:55,752 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-zkpd.c.gcp-upstream.internal','N') ;"
2026-08-08 08:30:55,983 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:30:56,229 [I] Table x_portal_user does not exist in database ranger
2026-08-08 08:30:56,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:30:56,477 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 08:30:56,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:30:56,705 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:30:56,963 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 08:30:56,963 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 08:30:57.907 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:57.922 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:57.937 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:57.950 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:57.966 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:57.984 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58.039 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58.046 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58.060 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58.070 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58.080 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58.093 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58.103 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58.109 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58.115 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58.122 UTC [5188] WARNING: there is no transaction in progress
2026-08-08 08:30:58,772 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 08:30:58,772 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 08:30:59,026 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 08:30:59,027 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:30:59,291 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 08:30:59,291 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:30:59,558 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 08:30:59,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:30:59,790 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:31:00,030 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-zkpd.c.gcp-upstream.internal';"
2026-08-08 08:31:00,260 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 08:31:00,260 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 08:31:00,512 [I] DB_PATCHES have already been applied
I20260808 08:31:00.518169 26280 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-admin:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasklAkZqe/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 08:31:00.518234 26280 mini_ranger.cc:193] Using host: 127.25.170.20
I20260808 08:31:00.522584 26280 mini_ranger.cc:227] Ranger admin URL: http://127.25.170.20:38801
Aug 08, 2026 8:31:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:31:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:31:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 8:31:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 8:31:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 8:31:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 8:31:01 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 08:31:01.653622 26280 mini_ranger.cc:160] Time spent starting Ranger: real 8.431s user 0.007s sys 0.005s
Aug 08, 2026 8:31:21 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 8:31:21 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 8:31:21 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 8:31:21 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 8:31:22 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 08:31:23.192054 26280 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.25.170.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.25.170.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/rangerkms_127.25.170.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/rangerkms_127.25.170.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.170.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.25.170.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.170.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/HTTP_127.25.170.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.170.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/HTTP_127.25.170.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 08:31:23 dist-test-slave-zkpd krb5kdc[4963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177883, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 08:31:23.285342 26280 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 08:31:23.296073 26280 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 08:31:24.114735 26280 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 08:31:24.114840 26280 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-kms
I20260808 08:31:24.114951 26280 mini_ranger_kms.cc:227] Using postgres at 127.25.170.20:54617
2026-08-08 08:31:24,340 [I] DB FLAVOR :POSTGRES
2026-08-08 08:31:24,340 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:31:24,341 [I] Checking connection
2026-08-08 08:31:24,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 08:31:24,601 [I] connection success
2026-08-08 08:31:24,601 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 08:31:24,601 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 08:31:24,602 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 08:31:24,841 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 08:31:24,841 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:31:24,842 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 08:31:24,842 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:54617/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 08:31:25,128 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 08:31:25.612334 26280 mini_ranger_kms.cc:310] Created kms service
I20260808 08:31:25.793519 26280 mini_ranger_kms.cc:326] Created kudu user
I20260808 08:31:25.835937 26280 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 08:31:25 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177883, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:31:26.217061 26280 mini_ranger_kms.cc:384] Added ranger policy
I20260808 08:31:26.217270 26280 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-kms:/tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 08:31:26.217296 26280 mini_ranger_kms.cc:240] Using host: 127.25.170.20
I20260808 08:31:26.222170 26280 mini_ranger_kms.cc:276] Ranger KMS PID: 5379
I20260808 08:31:26.222323 26280 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.25.170.20:37859
Aug 08, 2026 8:31:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:31:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:31:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 8:31:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 8:31:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 8:31:27 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 08:31:28.625542 26280 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.340s user 0.015s sys 0.194s
I20260808 08:31:28.625701 26280 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 08:31:28.625839 26280 mini_ranger_kms.cc:401] 127.25.170.20:37859/kms/v1/keys
Aug 08 08:31:28 dist-test-slave-zkpd krb5kdc[4963](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786177888, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.170.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 08:31:29 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177888, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.170.20@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
Aug 08 08:31:29 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177888, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.170.20@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
Aug 08 08:31:31 dist-test-slave-zkpd krb5kdc[4963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:31:31.874792 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:35023
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:43503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:35023
--ranger_config_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:37859/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:31:32.000844 5433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:31:32.001119 5433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:31:32.001190 5433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:31:32.005230 5433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:31:32.005311 5433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:31:32.005349 5433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:31:32.005406 5433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:31:32.005445 5433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:31:32.010778 5433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:43503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/wal
--ranger_kms_url=127.25.170.20:37859/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:35023
--ranger_config_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:35023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:31:32.012143 5433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:31:32.013221 5433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:31:32.021654 5439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:31:32.021654 5441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:31:32.021677 5438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:31:32.022037 5433 server_base.cc:1034] running on GCE node
I20260808 08:31:32.022598 5433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:31:32.023653 5433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:31:32.024852 5433 hybrid_clock.cc:648] HybridClock initialized: now 1786177892024823 us; error 40 us; skew 500 ppm
Aug 08 08:31:32 dist-test-slave-zkpd krb5kdc[4963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177892, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:31:32.031095 5433 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:31:32.031958 5433 webserver.cc:460] Webserver started at http://127.25.170.62:44153/ using document root <none> and password file <none>
I20260808 08:31:32.032450 5433 fs_manager.cc:359] Metadata directory not provided
I20260808 08:31:32.032502 5433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:31:32.032662 5433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:31:32 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177892, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:31:32.088586 5433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "e8212a64a9c74cb297a39ddaae648768"
format_stamp: "Formatted at 2026-08-08 08:31:32 on dist-test-slave-zkpd"
server_key: "adb1be9c84f727857f6b9f68839ee421"
server_key_iv: "cf57645cae1ba94c6d6f5f4eb363e93b"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:32.089251 5433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "e8212a64a9c74cb297a39ddaae648768"
format_stamp: "Formatted at 2026-08-08 08:31:32 on dist-test-slave-zkpd"
server_key: "adb1be9c84f727857f6b9f68839ee421"
server_key_iv: "cf57645cae1ba94c6d6f5f4eb363e93b"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:32.093303 5433 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:31:32.107275 5448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:31:32.108815 5433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:31:32.108970 5433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "e8212a64a9c74cb297a39ddaae648768"
format_stamp: "Formatted at 2026-08-08 08:31:32 on dist-test-slave-zkpd"
server_key: "adb1be9c84f727857f6b9f68839ee421"
server_key_iv: "cf57645cae1ba94c6d6f5f4eb363e93b"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:32.109122 5433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:31:32.123988 5433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:31:32.126546 5433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:31:32.126753 5433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:31:32.134418 5433 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:35023
I20260808 08:31:32.134449 5507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:35023 every 8 connection(s)
I20260808 08:31:32.135378 5433 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:31:32.138191 5508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:31:32.143122 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 5433
I20260808 08:31:32.143245 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:31:32.143581 26280 external_mini_cluster.cc:1428] Setting key 879b94b6aedd0daf5541b542a9b4ce0b
I20260808 08:31:32.144029 5508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768: Bootstrap starting.
I20260808 08:31:32.146561 5508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768: Neither blocks nor log segments found. Creating new log.
I20260808 08:31:32.147349 5508 log.cc:824] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768: Log is configured to *not* fsync() on all Append() calls
I20260808 08:31:32.149573 5508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768: No bootstrap required, opened a new log
Aug 08 08:31:32 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:31:32.154227 5508 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8212a64a9c74cb297a39ddaae648768" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35023 } }
I20260808 08:31:32.154470 5508 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:31:32.154547 5508 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8212a64a9c74cb297a39ddaae648768, State: Initialized, Role: FOLLOWER
I20260808 08:31:32.155020 5508 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8212a64a9c74cb297a39ddaae648768" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35023 } }
I20260808 08:31:32.155170 5508 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:31:32.155275 5508 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:31:32.155392 5508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:31:32.156322 5508 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8212a64a9c74cb297a39ddaae648768" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35023 } }
I20260808 08:31:32.156659 5508 leader_election.cc:302] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8212a64a9c74cb297a39ddaae648768; no voters:
I20260808 08:31:32.156955 5508 leader_election.cc:288] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:31:32.157096 5514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:31:32.157326 5514 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [term 1 LEADER]: Becoming Leader. State: Replica: e8212a64a9c74cb297a39ddaae648768, State: Running, Role: LEADER
I20260808 08:31:32.157666 5514 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8212a64a9c74cb297a39ddaae648768" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35023 } }
I20260808 08:31:32.158301 5508 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:31:32.159377 5516 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8212a64a9c74cb297a39ddaae648768" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8212a64a9c74cb297a39ddaae648768" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35023 } } }
I20260808 08:31:32.159521 5516 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [sys.catalog]: This master's current role is: LEADER
I20260808 08:31:32.159765 5512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:32.145066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43218 (local address 127.25.170.62:35023)
0808 08:31:32.145611 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:32.145626 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:32.145662 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:31:32.146426 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:32.146445 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:32.146849 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:32.147184 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:31:32.148113 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:32.149545 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:32.150771 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:32.151235 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:32.151359 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:32.154326 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:31:32.154332 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:31:32.154344 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:31:32.154370 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:31:32.156224 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:31:32.156738 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:31:32.156746 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:31:32.156756 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:31:32.156907 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:31:32.157274 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:31:32.157278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:31:32.157279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:31:32.157751 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:31:32.157946 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:32.158420 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 08:31:32.158828 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":148,"threads_started":1}
I20260808 08:31:32.159842 5517 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8212a64a9c74cb297a39ddaae648768. Latest consensus state: current_term: 1 leader_uuid: "e8212a64a9c74cb297a39ddaae648768" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8212a64a9c74cb297a39ddaae648768" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35023 } } }
I20260808 08:31:32.160002 5517 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768 [sys.catalog]: This master's current role is: LEADER
I20260808 08:31:32.161329 5508 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 08:31:32.164531 5525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:31:32.168690 5525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:31:32.174841 5525 catalog_manager.cc:1347] Generated new cluster ID: a709ac97d62f48bea93239012f269cd8
I20260808 08:31:32.174899 5525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:31:32.190516 5525 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:31:32.191424 5525 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:31:32.207187 5525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768: Generated new TSK 0
I20260808 08:31:32.207857 5525 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:31:32.990844 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:37859/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35023
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:43503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:31:33.130311 5557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:31:33.130590 5557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:31:33.130682 5557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:31:33.135787 5557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:31:33.135921 5557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:31:33.136034 5557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:31:33.143667 5557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:43503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.25.170.20:37859/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:31:33.144785 5557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:31:33.145869 5557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:31:33.155764 5568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:31:33.155764 5565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:31:33.156239 5566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:31:33.156921 5557 server_base.cc:1034] running on GCE node
I20260808 08:31:33.157343 5557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:31:33.158044 5557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:31:33.159210 5557 hybrid_clock.cc:648] HybridClock initialized: now 1786177893159182 us; error 46 us; skew 500 ppm
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:31:33.162299 5557 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:31:33.163224 5557 webserver.cc:460] Webserver started at http://127.25.170.1:39379/ using document root <none> and password file <none>
I20260808 08:31:33.163791 5557 fs_manager.cc:359] Metadata directory not provided
I20260808 08:31:33.163888 5557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:31:33.164165 5557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:31:33.178027 5557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "cd86dad235f546e7a8ab9787950a91b4"
format_stamp: "Formatted at 2026-08-08 08:31:33 on dist-test-slave-zkpd"
server_key: "7140f4b57a4a9ddee3794120f4270830"
server_key_iv: "782dfddb745bb5501b5444555b94bf29"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:33.178969 5557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "cd86dad235f546e7a8ab9787950a91b4"
format_stamp: "Formatted at 2026-08-08 08:31:33 on dist-test-slave-zkpd"
server_key: "7140f4b57a4a9ddee3794120f4270830"
server_key_iv: "782dfddb745bb5501b5444555b94bf29"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:33.184356 5557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 08:31:33.205006 5576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:31:33.206719 5557 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 08:31:33.206879 5557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "cd86dad235f546e7a8ab9787950a91b4"
format_stamp: "Formatted at 2026-08-08 08:31:33 on dist-test-slave-zkpd"
server_key: "7140f4b57a4a9ddee3794120f4270830"
server_key_iv: "782dfddb745bb5501b5444555b94bf29"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:33.207032 5557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:31:33.243916 5557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:31:33.248050 5557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:31:33.248328 5557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:31:33.249140 5557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:31:33.250474 5557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:31:33.250598 5557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:31:33.250767 5557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:31:33.250872 5557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:31:33.263643 5557 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:33951
I20260808 08:31:33.265165 5557 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:31:33.268293 5703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:33951 every 8 connection(s)
I20260808 08:31:33.272485 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 5557
I20260808 08:31:33.272641 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:31:33.272964 26280 external_mini_cluster.cc:1428] Setting key 5b6ade9f5060b7f4c9536b0ade0d221a
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:31:33.294270 5706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.270954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:35023 (local address 127.25.170.1:33649)
0808 08:31:33.274558 (+ 3604us) negotiation.cc:107] Waiting for socket to connect
0808 08:31:33.274623 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 08:31:33.278999 (+ 4376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:31:33.279631 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:31:33.279639 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:31:33.280037 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:31:33.280860 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:33.280885 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.282290 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.282294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:33.283585 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:33.283596 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.284641 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.284648 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:33.284940 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:33.285771 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:31:33.285797 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:31:33.287777 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:31:33.290565 (+ 2788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:31:33.290575 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:31:33.290590 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:31:33.290863 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:31:33.291188 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:31:33.291191 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:31:33.291193 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:31:33.291419 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:31:33.291974 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:31:33.291982 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:31:33.292378 (+ 396us) client_negotiation.cc:769] Sending connection context
0808 08:31:33.292646 (+ 268us) client_negotiation.cc:240] Negotiation successful
0808 08:31:33.293049 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3320,"thread_start_us":217,"threads_started":1}
I20260808 08:31:33.294989 5707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.273515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:33649 (local address 127.25.170.62:35023)
0808 08:31:33.277580 (+ 4065us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:33.277587 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:33.277610 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:31:33.279244 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:33.279247 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:33.279310 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:33.279418 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:31:33.281062 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.282087 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.283740 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.284263 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.284406 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:33.288084 (+ 3678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:31:33.288093 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:31:33.288098 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:31:33.288139 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:31:33.290408 (+ 2269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:31:33.290984 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:31:33.290988 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:31:33.290990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:31:33.291084 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:31:33.291531 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:31:33.291534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:31:33.291536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:31:33.291814 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:31:33.291974 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:33.294757 (+ 2783us) server_negotiation.cc:299] Negotiation successful
0808 08:31:33.294871 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3953,"thread_start_us":117,"threads_started":1}
I20260808 08:31:33.296697 5704 heartbeater.cc:347] Connected to a master server at 127.25.170.62:35023
I20260808 08:31:33.296968 5704 heartbeater.cc:464] Registering TS with master...
I20260808 08:31:33.297509 5704 heartbeater.cc:511] Master 127.25.170.62:35023 requested a full tablet report, sending...
I20260808 08:31:33.299311 5467 ts_manager.cc:194] Registered new tserver with Master: cd86dad235f546e7a8ab9787950a91b4 (127.25.170.1:33951)
I20260808 08:31:33.301015 5467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:33649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:31:33.313164 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:37859/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35023
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:43503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 08:31:33.456431 5710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:31:33.456707 5710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:31:33.456804 5710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:31:33.463773 5710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:31:33.463943 5710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:31:33.464129 5710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:31:33.470237 5710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:43503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.25.170.20:37859/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:31:33.471323 5710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:31:33.472512 5710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:31:33.482964 5718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:31:33.483515 5717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:31:33.484071 5720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:31:33.484552 5710 server_base.cc:1034] running on GCE node
I20260808 08:31:33.484990 5710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:31:33.485738 5710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:31:33.489048 5710 hybrid_clock.cc:648] HybridClock initialized: now 1786177893489011 us; error 49 us; skew 500 ppm
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:31:33.492791 5710 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:31:33.493907 5710 webserver.cc:460] Webserver started at http://127.25.170.2:32921/ using document root <none> and password file <none>
I20260808 08:31:33.494697 5710 fs_manager.cc:359] Metadata directory not provided
I20260808 08:31:33.494851 5710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:31:33.495144 5710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:31:33.517736 5710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "762e9424e7e240f8a6ca9aefe6707708"
format_stamp: "Formatted at 2026-08-08 08:31:33 on dist-test-slave-zkpd"
server_key: "1023ece8f3505fc04e3169a396a962a8"
server_key_iv: "26f182434531d3036b07a0a2f5cf9dc6"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:33.518517 5710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "762e9424e7e240f8a6ca9aefe6707708"
format_stamp: "Formatted at 2026-08-08 08:31:33 on dist-test-slave-zkpd"
server_key: "1023ece8f3505fc04e3169a396a962a8"
server_key_iv: "26f182434531d3036b07a0a2f5cf9dc6"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:33.523743 5710 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:31:33.554800 5727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:31:33.556695 5710 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:31:33.556838 5710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "762e9424e7e240f8a6ca9aefe6707708"
format_stamp: "Formatted at 2026-08-08 08:31:33 on dist-test-slave-zkpd"
server_key: "1023ece8f3505fc04e3169a396a962a8"
server_key_iv: "26f182434531d3036b07a0a2f5cf9dc6"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:33.556977 5710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:31:33.579377 5710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:31:33.583128 5710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:31:33.583341 5710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:31:33.583988 5710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:31:33.585059 5710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:31:33.585131 5710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:31:33.585199 5710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:31:33.585232 5710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:31:33.597966 5710 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:37923
I20260808 08:31:33.599092 5710 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:31:33.600087 5846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:37923 every 8 connection(s)
I20260808 08:31:33.603192 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 5710
I20260808 08:31:33.603330 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:31:33.603626 26280 external_mini_cluster.cc:1428] Setting key 3a09c6c2d97a75ea641b4389bc834882
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:31:33.618906 5707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.601846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:39185 (local address 127.25.170.62:35023)
0808 08:31:33.601987 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:33.601990 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:33.603172 (+ 1182us) server_negotiation.cc:407] Connection header received
0808 08:31:33.606084 (+ 2912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:33.606090 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:33.606151 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:33.606206 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:31:33.608028 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.608578 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.609707 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.610104 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.610215 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:33.614387 (+ 4172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:31:33.614392 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:31:33.614395 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:31:33.614430 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:31:33.616337 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:31:33.617055 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:31:33.617059 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:31:33.617061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:31:33.617154 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:31:33.617598 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:31:33.617603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:31:33.617604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:31:33.617871 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:31:33.617979 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:33.618668 (+ 689us) server_negotiation.cc:299] Negotiation successful
0808 08:31:33.618779 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:31:33.620131 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.602401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:35023 (local address 127.25.170.2:39185)
0808 08:31:33.602981 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 08:31:33.603045 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 08:31:33.605819 (+ 2774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:31:33.606637 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:31:33.606649 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:31:33.607064 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:31:33.607776 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:33.607813 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.608710 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.608712 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:33.609578 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:33.609586 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.610413 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.610419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:33.610725 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:33.611522 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:31:33.611546 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:31:33.614174 (+ 2628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:31:33.616532 (+ 2358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:31:33.616538 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:31:33.616556 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:31:33.616918 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:31:33.617265 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:31:33.617268 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:31:33.617270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:31:33.617469 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:31:33.618011 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:31:33.618017 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:31:33.618367 (+ 350us) client_negotiation.cc:769] Sending connection context
0808 08:31:33.618591 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 08:31:33.618979 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":195,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
I20260808 08:31:33.621451 5847 heartbeater.cc:347] Connected to a master server at 127.25.170.62:35023
I20260808 08:31:33.621717 5847 heartbeater.cc:464] Registering TS with master...
I20260808 08:31:33.622337 5847 heartbeater.cc:511] Master 127.25.170.62:35023 requested a full tablet report, sending...
I20260808 08:31:33.623507 5467 ts_manager.cc:194] Registered new tserver with Master: 762e9424e7e240f8a6ca9aefe6707708 (127.25.170.2:37923)
I20260808 08:31:33.624126 5467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:39185
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:31:33.638459 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:37859/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35023
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:43503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:31:33.810060 5852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:31:33.810468 5852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:31:33.810559 5852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
W20260808 08:31:33.817512 5852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:31:33.817600 5852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:31:33.817720 5852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:31:33.826646 5852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:43503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.25.170.20:37859/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:35023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:31:33.828188 5852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:31:33.829754 5852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:31:33.843605 5861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:31:33.843756 5858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:31:33.843616 5859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:31:33.844130 5852 server_base.cc:1034] running on GCE node
I20260808 08:31:33.844588 5852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:31:33.845400 5852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:31:33.846597 5852 hybrid_clock.cc:648] HybridClock initialized: now 1786177893846571 us; error 35 us; skew 500 ppm
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:31:33.850814 5852 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:31:33.852001 5852 webserver.cc:460] Webserver started at http://127.25.170.3:33941/ using document root <none> and password file <none>
I20260808 08:31:33.852782 5852 fs_manager.cc:359] Metadata directory not provided
I20260808 08:31:33.852881 5852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:31:33.853137 5852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:31:33.870297 5852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "c4e87a2ee9dd43348cc689d50b69d473"
format_stamp: "Formatted at 2026-08-08 08:31:33 on dist-test-slave-zkpd"
server_key: "02d50135498367fcbf01bcab9545d9bb"
server_key_iv: "eee2de8c32bc45be58809ca33459c5e1"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:33.871074 5852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "c4e87a2ee9dd43348cc689d50b69d473"
format_stamp: "Formatted at 2026-08-08 08:31:33 on dist-test-slave-zkpd"
server_key: "02d50135498367fcbf01bcab9545d9bb"
server_key_iv: "eee2de8c32bc45be58809ca33459c5e1"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:33.876941 5852 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:31:33.893633 5868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:31:33.895292 5852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:31:33.895440 5852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "c4e87a2ee9dd43348cc689d50b69d473"
format_stamp: "Formatted at 2026-08-08 08:31:33 on dist-test-slave-zkpd"
server_key: "02d50135498367fcbf01bcab9545d9bb"
server_key_iv: "eee2de8c32bc45be58809ca33459c5e1"
server_key_version: "kuduclusterkey@0"
I20260808 08:31:33.895598 5852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:31:33.917311 5852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:31:33.921295 5852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:31:33.921525 5852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:31:33.922382 5852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:31:33.923525 5852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:31:33.923602 5852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:31:33.923671 5852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:31:33.923715 5852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:31:33.937031 5852 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:42215
I20260808 08:31:33.937181 5990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:42215 every 8 connection(s)
I20260808 08:31:33.938050 5852 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:31:33.939193 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 5852
I20260808 08:31:33.939334 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:31:33.939644 26280 external_mini_cluster.cc:1428] Setting key 28ff2b1f63a94dd6952b9681bf6ff391
Aug 08 08:31:33 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:31:33.954877 5707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.941923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:46941 (local address 127.25.170.62:35023)
0808 08:31:33.942047 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:33.942052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:33.942726 (+ 674us) server_negotiation.cc:407] Connection header received
0808 08:31:33.943888 (+ 1162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:33.943929 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:33.943991 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:33.944105 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:31:33.945403 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.945994 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.947375 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.947629 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.947771 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:33.950493 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:31:33.950497 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:31:33.950499 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:31:33.950524 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:31:33.952197 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:31:33.952904 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:31:33.952908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:31:33.952910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:31:33.953010 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:31:33.953492 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:31:33.953496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:31:33.953498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:31:33.953777 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:31:33.953864 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:33.954559 (+ 695us) server_negotiation.cc:299] Negotiation successful
0808 08:31:33.954685 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 08:31:33.955976 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.940841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:35023 (local address 127.25.170.3:46941)
0808 08:31:33.942565 (+ 1724us) negotiation.cc:107] Waiting for socket to connect
0808 08:31:33.942606 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:31:33.943657 (+ 1051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:31:33.944302 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:31:33.944309 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:31:33.944675 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:31:33.945247 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:33.945263 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.946138 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.946148 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:33.947220 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:33.947231 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.947814 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.947818 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:33.948068 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:33.948750 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:31:33.948768 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:31:33.950312 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:31:33.952364 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:31:33.952370 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:31:33.952387 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:31:33.952775 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:31:33.953146 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:31:33.953149 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:31:33.953152 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:31:33.953372 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:31:33.953960 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:31:33.953966 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:31:33.954235 (+ 269us) client_negotiation.cc:769] Sending connection context
0808 08:31:33.954511 (+ 276us) client_negotiation.cc:240] Negotiation successful
0808 08:31:33.954844 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1525,"thread_start_us":190,"threads_started":1}
I20260808 08:31:33.957257 5991 heartbeater.cc:347] Connected to a master server at 127.25.170.62:35023
I20260808 08:31:33.957508 5991 heartbeater.cc:464] Registering TS with master...
I20260808 08:31:33.958081 5991 heartbeater.cc:511] Master 127.25.170.62:35023 requested a full tablet report, sending...
I20260808 08:31:33.959277 5467 ts_manager.cc:194] Registered new tserver with Master: c4e87a2ee9dd43348cc689d50b69d473 (127.25.170.3:42215)
I20260808 08:31:33.960041 5467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:46941
I20260808 08:31:33.967470 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:31:33.978861 5707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.969870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43230 (local address 127.25.170.62:35023)
0808 08:31:33.970008 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:33.970013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:33.970299 (+ 286us) server_negotiation.cc:407] Connection header received
0808 08:31:33.970469 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:33.970473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:33.970527 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:33.970618 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:31:33.971422 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.972081 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.972999 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:33.973257 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:33.973376 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:33.975153 (+ 1777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:31:33.975157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:31:33.975160 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:31:33.975187 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:31:33.976971 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:31:33.977524 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:31:33.977527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:31:33.977529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:31:33.977619 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:31:33.977957 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:31:33.977960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:31:33.977962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:31:33.978168 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:31:33.978296 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:33.978589 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 08:31:33.978705 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:31:33.982285 5467 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:31:33.986675 5467 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:31:34.008495 6007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.997854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:33951 (local address 127.0.0.1:44094)
0808 08:31:34.000770 (+ 2916us) negotiation.cc:107] Waiting for socket to connect
0808 08:31:34.000823 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:31:34.000986 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:31:34.001708 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:31:34.001727 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:31:34.001751 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:31:34.001918 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:34.001925 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.004441 (+ 2516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.004445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:34.006034 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:34.006045 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.008056 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.008059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:34.008166 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.008189 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:31:34.008259 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 08:31:34.008330 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2725,"mutex_wait_us":39,"thread_start_us":114,"threads_started":1}
I20260808 08:31:34.009096 6010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.999747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33424 (local address 127.25.170.3:42215)
0808 08:31:34.000491 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:34.000503 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:34.001563 (+ 1060us) server_negotiation.cc:407] Connection header received
0808 08:31:34.001658 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:34.001664 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:34.001881 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:34.002511 (+ 630us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:31:34.003006 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.004352 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.006502 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.007464 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.007582 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.007741 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:34.008584 (+ 843us) server_negotiation.cc:299] Negotiation successful
0808 08:31:34.008706 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":154,"threads_started":1}
I20260808 08:31:34.009258 6009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.999346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44094 (local address 127.25.170.1:33951)
0808 08:31:34.000297 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:34.000305 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:34.000956 (+ 651us) server_negotiation.cc:407] Connection header received
0808 08:31:34.001176 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:34.001182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:34.001395 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:34.001543 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:31:34.002063 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.004162 (+ 2099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.006201 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.007722 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.007838 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.007993 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:34.008968 (+ 975us) server_negotiation.cc:299] Negotiation successful
0808 08:31:34.009066 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":821,"thread_start_us":126,"threads_started":1}
I20260808 08:31:34.008502 6005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.998098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:42215 (local address 127.0.0.1:33424)
0808 08:31:34.001351 (+ 3253us) negotiation.cc:107] Waiting for socket to connect
0808 08:31:34.001366 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:31:34.001461 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:31:34.002685 (+ 1224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:31:34.002693 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:31:34.002713 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:31:34.002855 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:34.002863 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.004514 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.004518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:34.006283 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:34.006296 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.007821 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.007825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:34.007995 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.008048 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 08:31:34.008173 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 08:31:34.008316 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3153,"mutex_wait_us":376,"thread_start_us":98,"threads_started":1}
I20260808 08:31:34.012777 5629 tablet_service.cc:1467] Processing CreateTablet for tablet 54503730e1d64da0ad16045465da5344 (DEFAULT_TABLE table=test-table [id=508d41747f554d4ea94b34a171d3182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:31:34.013942 5629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54503730e1d64da0ad16045465da5344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:31:34.013797 5903 tablet_service.cc:1467] Processing CreateTablet for tablet 54503730e1d64da0ad16045465da5344 (DEFAULT_TABLE table=test-table [id=508d41747f554d4ea94b34a171d3182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:31:34.014948 5903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54503730e1d64da0ad16045465da5344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:31:34.025579 6012 tablet_bootstrap.cc:492] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: Bootstrap starting.
I20260808 08:31:34.028617 6012 tablet_bootstrap.cc:654] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: Neither blocks nor log segments found. Creating new log.
I20260808 08:31:34.029616 6012 log.cc:824] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: Log is configured to *not* fsync() on all Append() calls
I20260808 08:31:34.031934 6012 tablet_bootstrap.cc:492] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: No bootstrap required, opened a new log
I20260808 08:31:34.032135 6012 ts_tablet_manager.cc:1397] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 08:31:34.032270 6011 tablet_bootstrap.cc:492] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4: Bootstrap starting.
I20260808 08:31:34.033622 6006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.998702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:37923 (local address 127.0.0.1:37736)
0808 08:31:34.004789 (+ 6087us) negotiation.cc:107] Waiting for socket to connect
0808 08:31:34.004805 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:31:34.004925 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:31:34.027164 (+ 22239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:31:34.027168 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:31:34.027195 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:31:34.027341 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:34.027349 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.030205 (+ 2856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.030231 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:34.031586 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:34.031600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.033136 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.033140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:34.033267 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.033303 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:31:34.033371 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 08:31:34.033458 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6017,"thread_start_us":122,"threads_started":1}
I20260808 08:31:34.034529 6008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:33.998855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37736 (local address 127.25.170.2:37923)
0808 08:31:34.026568 (+ 27713us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:34.026582 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:34.026615 (+ 33us) server_negotiation.cc:407] Connection header received
0808 08:31:34.026708 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:34.026713 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:34.026966 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:34.027537 (+ 571us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:31:34.027687 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.029975 (+ 2288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.031906 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.032967 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.033971 (+ 1004us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.034141 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:34.034200 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 08:31:34.034319 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27572,"thread_start_us":96,"threads_started":1}
I20260808 08:31:34.035545 6011 tablet_bootstrap.cc:654] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4: Neither blocks nor log segments found. Creating new log.
I20260808 08:31:34.036645 6011 log.cc:824] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4: Log is configured to *not* fsync() on all Append() calls
I20260808 08:31:34.036966 6012 raft_consensus.cc:348] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd86dad235f546e7a8ab9787950a91b4" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33951 } } peers { permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 } } peers { permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 } }
I20260808 08:31:34.037351 6012 raft_consensus.cc:374] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:31:34.037452 6012 raft_consensus.cc:729] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4e87a2ee9dd43348cc689d50b69d473, State: Initialized, Role: FOLLOWER
I20260808 08:31:34.037537 5777 tablet_service.cc:1467] Processing CreateTablet for tablet 54503730e1d64da0ad16045465da5344 (DEFAULT_TABLE table=test-table [id=508d41747f554d4ea94b34a171d3182b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:31:34.038023 6012 consensus_queue.cc:260] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd86dad235f546e7a8ab9787950a91b4" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33951 } } peers { permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 } } peers { permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 } }
I20260808 08:31:34.038630 5777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54503730e1d64da0ad16045465da5344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:31:34.039158 6012 ts_tablet_manager.cc:1428] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:31:34.039543 5991 heartbeater.cc:503] Master 127.25.170.62:35023 was elected leader, sending a full tablet report...
I20260808 08:31:34.045751 6011 tablet_bootstrap.cc:492] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4: No bootstrap required, opened a new log
I20260808 08:31:34.046011 6011 ts_tablet_manager.cc:1397] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260808 08:31:34.047405 6016 tablet_bootstrap.cc:492] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Bootstrap starting.
I20260808 08:31:34.050369 6016 tablet_bootstrap.cc:654] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Neither blocks nor log segments found. Creating new log.
I20260808 08:31:34.051784 6011 raft_consensus.cc:348] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd86dad235f546e7a8ab9787950a91b4" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33951 } } peers { permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 } } peers { permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 } }
I20260808 08:31:34.052085 6011 raft_consensus.cc:374] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:31:34.052150 6011 raft_consensus.cc:729] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd86dad235f546e7a8ab9787950a91b4, State: Initialized, Role: FOLLOWER
I20260808 08:31:34.052701 6011 consensus_queue.cc:260] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd86dad235f546e7a8ab9787950a91b4" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33951 } } peers { permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 } } peers { permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 } }
I20260808 08:31:34.053314 6016 log.cc:824] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Log is configured to *not* fsync() on all Append() calls
I20260808 08:31:34.053938 6011 ts_tablet_manager.cc:1428] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260808 08:31:34.054364 5704 heartbeater.cc:503] Master 127.25.170.62:35023 was elected leader, sending a full tablet report...
I20260808 08:31:34.055171 6016 tablet_bootstrap.cc:492] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: No bootstrap required, opened a new log
I20260808 08:31:34.055410 6016 ts_tablet_manager.cc:1397] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 08:31:34.060388 6016 raft_consensus.cc:348] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd86dad235f546e7a8ab9787950a91b4" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33951 } } peers { permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 } } peers { permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 } }
I20260808 08:31:34.060755 6016 raft_consensus.cc:374] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:31:34.060977 6016 raft_consensus.cc:729] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762e9424e7e240f8a6ca9aefe6707708, State: Initialized, Role: FOLLOWER
I20260808 08:31:34.061556 6016 consensus_queue.cc:260] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd86dad235f546e7a8ab9787950a91b4" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33951 } } peers { permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 } } peers { permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 } }
I20260808 08:31:34.062394 5847 heartbeater.cc:503] Master 127.25.170.62:35023 was elected leader, sending a full tablet report...
I20260808 08:31:34.062861 6016 ts_tablet_manager.cc:1428] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260808 08:31:34.100849 5848 tablet.cc:2369] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 08:31:34 dist-test-slave-zkpd krb5kdc[4963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177893, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
W20260808 08:31:34.192656 5993 tablet.cc:2369] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:31:34.274997 5705 tablet.cc:2369] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:31:34.287370 6018 raft_consensus.cc:482] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:31:34.287590 6018 raft_consensus.cc:504] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd86dad235f546e7a8ab9787950a91b4" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33951 } } peers { permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 } } peers { permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 } }
I20260808 08:31:34.289150 6018 leader_election.cc:288] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 762e9424e7e240f8a6ca9aefe6707708 (127.25.170.2:37923), c4e87a2ee9dd43348cc689d50b69d473 (127.25.170.3:42215)
I20260808 08:31:34.300153 6010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:34.289988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:57755 (local address 127.25.170.3:42215)
0808 08:31:34.290134 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:34.290141 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:34.290158 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:31:34.290231 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:34.290233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:34.290304 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:34.290383 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:31:34.296046 (+ 5663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.296893 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.298726 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.299351 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.299454 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.299512 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:34.299922 (+ 410us) server_negotiation.cc:299] Negotiation successful
0808 08:31:34.300009 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:31:34.300889 6023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:34.289565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:42215 (local address 127.25.170.1:57755)
0808 08:31:34.289925 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0808 08:31:34.289944 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:31:34.290082 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:31:34.290887 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:31:34.290891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:31:34.290912 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:31:34.291036 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:34.291046 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.297088 (+ 6042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.297091 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:34.298553 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:34.298566 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.299615 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.299619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:34.299742 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.299767 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:31:34.300641 (+ 874us) client_negotiation.cc:240] Negotiation successful
0808 08:31:34.300737 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":118,"threads_started":1}
I20260808 08:31:34.301733 5920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54503730e1d64da0ad16045465da5344" candidate_uuid: "cd86dad235f546e7a8ab9787950a91b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4e87a2ee9dd43348cc689d50b69d473" is_pre_election: true
I20260808 08:31:34.302132 5920 raft_consensus.cc:2454] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd86dad235f546e7a8ab9787950a91b4 in term 0.
I20260808 08:31:34.302753 5580 leader_election.cc:302] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4e87a2ee9dd43348cc689d50b69d473, cd86dad235f546e7a8ab9787950a91b4; no voters:
I20260808 08:31:34.303083 6018 raft_consensus.cc:2781] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:31:34.303161 6018 raft_consensus.cc:482] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:31:34.303201 6018 raft_consensus.cc:3037] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:31:34.304610 6018 raft_consensus.cc:504] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd86dad235f546e7a8ab9787950a91b4" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33951 } } peers { permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 } } peers { permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 } }
I20260808 08:31:34.304991 6018 leader_election.cc:288] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [CANDIDATE]: Term 1 election: Requested vote from peers 762e9424e7e240f8a6ca9aefe6707708 (127.25.170.2:37923), c4e87a2ee9dd43348cc689d50b69d473 (127.25.170.3:42215)
I20260808 08:31:34.305609 5920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54503730e1d64da0ad16045465da5344" candidate_uuid: "cd86dad235f546e7a8ab9787950a91b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4e87a2ee9dd43348cc689d50b69d473"
I20260808 08:31:34.305738 5920 raft_consensus.cc:3037] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:31:34.307060 5920 raft_consensus.cc:2454] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd86dad235f546e7a8ab9787950a91b4 in term 1.
I20260808 08:31:34.307466 5580 leader_election.cc:302] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4e87a2ee9dd43348cc689d50b69d473, cd86dad235f546e7a8ab9787950a91b4; no voters:
I20260808 08:31:34.307685 6018 raft_consensus.cc:2781] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:31:34.307940 6018 raft_consensus.cc:686] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [term 1 LEADER]: Becoming Leader. State: Replica: cd86dad235f546e7a8ab9787950a91b4, State: Running, Role: LEADER
I20260808 08:31:34.308305 6018 consensus_queue.cc:237] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd86dad235f546e7a8ab9787950a91b4" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33951 } } peers { permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 } } peers { permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 } }
I20260808 08:31:34.309273 6008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:34.290690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:34359 (local address 127.25.170.2:37923)
0808 08:31:34.290821 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:34.290826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:34.295997 (+ 5171us) server_negotiation.cc:407] Connection header received
0808 08:31:34.296206 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:34.296210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:34.296264 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:34.296326 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:31:34.305655 (+ 9329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.306418 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.308041 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.308625 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.308716 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.308763 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:34.309081 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 08:31:34.309159 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 08:31:34.309679 6024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:34.290296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:37923 (local address 127.25.170.1:34359)
0808 08:31:34.295861 (+ 5565us) negotiation.cc:107] Waiting for socket to connect
0808 08:31:34.295877 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:31:34.296078 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:31:34.305347 (+ 9269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:31:34.305351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:31:34.305375 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:31:34.305494 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:34.305500 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.306566 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.306570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:34.307864 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:31:34.307877 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.308858 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.308861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:31:34.308953 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.308975 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:31:34.309478 (+ 503us) client_negotiation.cc:240] Negotiation successful
0808 08:31:34.309552 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5488,"thread_start_us":111,"threads_started":1}
I20260808 08:31:34.310474 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54503730e1d64da0ad16045465da5344" candidate_uuid: "cd86dad235f546e7a8ab9787950a91b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762e9424e7e240f8a6ca9aefe6707708" is_pre_election: true
I20260808 08:31:34.310765 5797 raft_consensus.cc:2454] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd86dad235f546e7a8ab9787950a91b4 in term 0.
I20260808 08:31:34.311125 5796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54503730e1d64da0ad16045465da5344" candidate_uuid: "cd86dad235f546e7a8ab9787950a91b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762e9424e7e240f8a6ca9aefe6707708"
I20260808 08:31:34.311249 5796 raft_consensus.cc:3037] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:31:34.312659 5796 raft_consensus.cc:2454] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd86dad235f546e7a8ab9787950a91b4 in term 1.
I20260808 08:31:34.316247 5467 catalog_manager.cc:5495] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd86dad235f546e7a8ab9787950a91b4 (127.25.170.1). New cstate: current_term: 1 leader_uuid: "cd86dad235f546e7a8ab9787950a91b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd86dad235f546e7a8ab9787950a91b4" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260808 08:31:34.376223 6009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:34.370352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44104 (local address 127.25.170.1:33951)
0808 08:31:34.370473 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 08:31:34.370478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:31:34.370494 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:31:34.370590 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:31:34.370593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:31:34.370670 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:31:34.370804 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:31:34.371236 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.372201 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.373503 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:31:34.373890 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:31:34.373994 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:31:34.374501 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:31:34.375114 (+ 613us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:31:34.375265 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 08:31:34.375758 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 08:31:34.375828 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 08:31:34.385809 5920 raft_consensus.cc:1261] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473 [term 1 FOLLOWER]: Refusing update from remote peer cd86dad235f546e7a8ab9787950a91b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:31:34.386709 6025 consensus_queue.cc:1035] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4e87a2ee9dd43348cc689d50b69d473" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:31:34.392671 5796 raft_consensus.cc:1261] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [term 1 FOLLOWER]: Refusing update from remote peer cd86dad235f546e7a8ab9787950a91b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:31:34.393436 6025 consensus_queue.cc:1035] T 54503730e1d64da0ad16045465da5344 P cd86dad235f546e7a8ab9787950a91b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762e9424e7e240f8a6ca9aefe6707708" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:31:34.403105 6028 mvcc.cc:205] Tried to move back new op lower bound from 7316184655395069952 to 7316184655090274304. Current Snapshot: MvccSnapshot[applied={T|T < 7316184655395069952}]
I20260808 08:31:34.406987 6029 mvcc.cc:205] Tried to move back new op lower bound from 7316184655395069952 to 7316184655090274304. Current Snapshot: MvccSnapshot[applied={T|T < 7316184655395069952}]
I20260808 08:31:34.413982 5467 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:31:34.414170 5467 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:31:34.417024 5467 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8212a64a9c74cb297a39ddaae648768: Sending DeleteTablet for 3 replicas of tablet 54503730e1d64da0ad16045465da5344
I20260808 08:31:34.418223 5629 tablet_service.cc:1514] Processing DeleteTablet for tablet 54503730e1d64da0ad16045465da5344 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:31:34 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:44094
I20260808 08:31:34.418741 5777 tablet_service.cc:1514] Processing DeleteTablet for tablet 54503730e1d64da0ad16045465da5344 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:31:34 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:37736
I20260808 08:31:34.419327 5903 tablet_service.cc:1514] Processing DeleteTablet for tablet 54503730e1d64da0ad16045465da5344 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:31:34 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:33424
I20260808 08:31:34.419545 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 5557
I20260808 08:31:34.421749 6037 tablet_replica.cc:330] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: stopping tablet replica
I20260808 08:31:34.422008 6038 tablet_replica.cc:330] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: stopping tablet replica
I20260808 08:31:34.422533 6038 raft_consensus.cc:2229] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:31:34.422910 6037 raft_consensus.cc:2229] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:31:34.423236 6037 pending_rounds.cc:62] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Trying to abort 2 pending ops.
I20260808 08:31:34.423555 6038 raft_consensus.cc:2258] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:31:34.423715 6037 pending_rounds.cc:68] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316184655395069952 op_type: WRITE_OP write_request { tablet_id: "54503730e1d64da0ad16045465da5344" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\222\325\333\323\006\"8\n\ntest-admin\022*\n 508d41747f554d4ea94b34a171d3182b\020\001\030\001 \001(\001" signature: "<redacted>""\007\261Y<>\245\037\303uw`\377\257Dw\353e|\372@\014\360\006\347\210W\032\210\232\035\257\203\213C\377\345\275\257o\345\024\262\007}s\260\252K\254C\233\010\301\270\34449\010/\330\337\233.\303" signing_key_seq_num: 0 } } request_id { client_id: "ca49ff39da3f4850a6c6b29365297f8b" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260808 08:31:34.424381 6037 pending_rounds.cc:68] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316184655090274304 op_type: NO_OP noop_request { }
I20260808 08:31:34.425771 6038 ts_tablet_manager.cc:1905] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:31:34.425920 6037 raft_consensus.cc:2866] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260808 08:31:34.426052 6037 raft_consensus.cc:2258] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:31:34.429261 6038 ts_tablet_manager.cc:1918] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:31:34.429782 6038 log.cc:1196] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/54503730e1d64da0ad16045465da5344
I20260808 08:31:34.430199 6038 ts_tablet_manager.cc:1939] T 54503730e1d64da0ad16045465da5344 P c4e87a2ee9dd43348cc689d50b69d473: Deleting consensus metadata
I20260808 08:31:34.431578 5451 catalog_manager.cc:4841] TS c4e87a2ee9dd43348cc689d50b69d473 (127.25.170.3:42215): tablet 54503730e1d64da0ad16045465da5344 (table test-table [id=508d41747f554d4ea94b34a171d3182b]) successfully deleted
W20260808 08:31:34.424449 6032 consensus_queue.cc:1159] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "762e9424e7e240f8a6ca9aefe6707708" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
W20260808 08:31:34.434862 5730 connection.cc:441] server connection from 127.25.170.1:34359 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.25.170.1:34359 (request call id 3) could send its response
I20260808 08:31:34.436048 6037 ts_tablet_manager.cc:1905] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:31:34.438755 6037 ts_tablet_manager.cc:1918] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:31:34.438869 6037 log.cc:1196] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/54503730e1d64da0ad16045465da5344
I20260808 08:31:34.439213 6037 ts_tablet_manager.cc:1939] T 54503730e1d64da0ad16045465da5344 P 762e9424e7e240f8a6ca9aefe6707708: Deleting consensus metadata
I20260808 08:31:34.440623 5452 catalog_manager.cc:4841] TS 762e9424e7e240f8a6ca9aefe6707708 (127.25.170.2:37923): tablet 54503730e1d64da0ad16045465da5344 (table test-table [id=508d41747f554d4ea94b34a171d3182b]) successfully deleted
W20260808 08:31:34.448261 5449 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:33951 (error 108)
I20260808 08:31:34.449857 6006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:31:34.449517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:33951 (local address 127.0.0.1:44118)
0808 08:31:34.449701 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 08:31:34.449769 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:33951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260808 08:31:34.450032 5449 catalog_manager.cc:4584] TS cd86dad235f546e7a8ab9787950a91b4 (127.25.170.1:33951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 54503730e1d64da0ad16045465da5344: Network error: Client connection negotiation failed: client connection to 127.25.170.1:33951: connect: Connection refused (error 111)
I20260808 08:31:34.450377 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 5710
I20260808 08:31:34.463919 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 5852
I20260808 08:31:34.472815 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 5433
I20260808 08:31:34.480976 26280 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 08:31:34.836001 26280 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 08:31:34.836140 26280 mini_ranger.cc:66] Stopping Ranger...
I20260808 08:31:35.180740 26280 mini_ranger.cc:68] Stopped Ranger
2026-08-08 08:31:35.181 UTC [4993] LOG: received smart shutdown request
2026-08-08 08:31:35.184 UTC [4993] LOG: background worker "logical replication launcher" (PID 5003) exited with exit code 1
2026-08-08 08:31:35.185 UTC [4997] LOG: shutting down
2026-08-08 08:31:35.320 UTC [4993] LOG: database system is shut down
2026-08-08T08:31:35Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46863 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:31:35 dist-test-slave-zkpd krb5kdc[6056](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:31:35 dist-test-slave-zkpd krb5kdc[6056](info): set up 2 sockets
Aug 08 08:31:35 dist-test-slave-zkpd krb5kdc[6056](info): commencing operation
krb5kdc: starting...
W20260808 08:31:36.528679 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:31:36 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:31:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:31:36Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.25.170.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.25.170.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/rangeradmin_127.25.170.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/rangeradmin_127.25.170.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.25.170.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.25.170.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/rangerlookup_127.25.170.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/rangerlookup_127.25.170.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.170.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.25.170.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/HTTP_127.25.170.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/HTTP_127.25.170.20@KRBTEST.COM.keytab.
I20260808 08:31:36.696341 26280 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasklAkZqe/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/postgres -l logfile start
2026-08-08 08:31:39.039 UTC [6087] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 08:31:39.039 UTC [6087] LOG: listening on IPv4 address "127.25.170.20", port 33171
2026-08-08 08:31:39.042 UTC [6087] LOG: listening on Unix socket "/tmp/.s.PGSQL.33171"
2026-08-08 08:31:39.072 UTC [6090] LOG: database system was shut down at 2026-08-08 08:31:37 UTC
2026-08-08 08:31:39.076 UTC [6087] LOG: database system is ready to accept connections
I20260808 08:31:40.074342 26280 mini_postgres.cc:96] Postgres bound to 33171
2026-08-08 08:31:40.081 UTC [6100] FATAL: database "slave" does not exist
127.25.170.20:33171 - accepting connections
I20260808 08:31:40.082324 26280 mini_ranger.cc:161] Starting Ranger...
I20260808 08:31:40.099076 26280 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 08:31:40.535838 26280 mini_ranger.cc:87] Created ranger Postgres database
I20260808 08:31:40.535954 26280 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-admin
2026-08-08 08:31:40,800 [I] DB FLAVOR :POSTGRES
2026-08-08 08:31:40,801 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:31:40,801 [I] Checking connection..
2026-08-08 08:31:40,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 08:31:41,042 [I] Checking connection passed.
2026-08-08 08:31:41,043 [I] --------- Verifying version history table ---------
2026-08-08 08:31:41,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:31:41,297 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:31:41,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:31:41,537 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:31:41,537 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 08:31:41,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 08:31:41.793 UTC [6170] WARNING: there is no transaction in progress
2026-08-08 08:31:41,800 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 08:31:41,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:31:42,031 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 08:31:42,031 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:31:42,031 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 08:31:42,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 08:31:42,527 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-zkpd.c.gcp-upstream.internal','N') ;"
2026-08-08 08:31:42,782 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:31:43,012 [I] Table x_portal_user does not exist in database ranger
2026-08-08 08:31:43,012 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:31:43,280 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 08:31:43,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:31:43,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:31:43,794 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 08:31:43,795 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 08:31:44.710 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.725 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.740 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.753 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.768 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.787 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.847 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.853 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.866 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.876 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.886 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.899 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.909 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.915 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.921 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:44.927 UTC [6284] WARNING: there is no transaction in progress
2026-08-08 08:31:45,521 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 08:31:45,521 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 08:31:45,740 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 08:31:45,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:31:46,000 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 08:31:46,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:31:46,251 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 08:31:46,251 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:31:46,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:31:46,743 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-zkpd.c.gcp-upstream.internal';"
2026-08-08 08:31:46,978 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 08:31:46,978 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 08:31:47,245 [I] DB_PATCHES have already been applied
I20260808 08:31:47.251318 26280 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-admin:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasklAkZqe/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 08:31:47.251390 26280 mini_ranger.cc:193] Using host: 127.25.170.20
I20260808 08:31:47.255959 26280 mini_ranger.cc:227] Ranger admin URL: http://127.25.170.20:50449
Aug 08, 2026 8:31:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:31:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:31:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 8:31:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 8:31:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 8:31:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 8:31:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 08:31:48.408910 26280 mini_ranger.cc:160] Time spent starting Ranger: real 8.327s user 0.001s sys 0.011s
Aug 08, 2026 8:32:09 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 8:32:09 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 8:32:09 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 8:32:09 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 8:32:10 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 08:32:10.673839 26280 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.25.170.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.25.170.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/rangerkms_127.25.170.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.25.170.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/rangerkms_127.25.170.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.170.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.25.170.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.170.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/HTTP_127.25.170.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.170.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/HTTP_127.25.170.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 08:32:10 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177930, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 08:32:10.765784 26280 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 08:32:10.776407 26280 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 08:32:11.589615 26280 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 08:32:11.589708 26280 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-kms
I20260808 08:32:11.589731 26280 mini_ranger_kms.cc:227] Using postgres at 127.25.170.20:33171
2026-08-08 08:32:11,762 [I] DB FLAVOR :POSTGRES
2026-08-08 08:32:11,763 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:32:11,763 [I] Checking connection
2026-08-08 08:32:11,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 08:32:11,995 [I] connection success
2026-08-08 08:32:11,996 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 08:32:11,996 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 08:32:11,996 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 08:32:12,237 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 08:32:12,237 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:32:12,237 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 08:32:12,237 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.170.20:33171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 08:32:12,502 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 08:32:12.928790 26280 mini_ranger_kms.cc:310] Created kms service
I20260808 08:32:13.101555 26280 mini_ranger_kms.cc:326] Created kudu user
I20260808 08:32:13.146409 26280 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 08:32:13 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177930, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:13.553064 26280 mini_ranger_kms.cc:384] Added ranger policy
I20260808 08:32:13.553237 26280 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-kms:/tmp/dist-test-tasklAkZqe/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasklAkZqe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 08:32:13.553267 26280 mini_ranger_kms.cc:240] Using host: 127.25.170.20
I20260808 08:32:13.558008 26280 mini_ranger_kms.cc:276] Ranger KMS PID: 6467
I20260808 08:32:13.558094 26280 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.25.170.20:32773
Aug 08, 2026 8:32:14 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:32:14 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:32:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 8:32:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 8:32:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 8:32:14 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 08:32:15 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786177935, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.170.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:15.887220 26280 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.121s user 0.024s sys 0.135s
I20260808 08:32:15.887349 26280 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 08:32:15.887413 26280 mini_ranger_kms.cc:401] 127.25.170.20:32773/kms/v1/keys
Aug 08 08:32:16 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177935, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.170.20@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
Aug 08 08:32:16 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177935, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.170.20@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
Aug 08 08:32:18 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:32:18.742687 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33703
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:33703
--ranger_config_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:32773/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:18.854322 6521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:18.854543 6521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:18.854615 6521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:18.858664 6521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:32:18.858721 6521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:18.858740 6521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:18.858757 6521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:32:18.858810 6521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:32:18.864131 6521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal
--ranger_kms_url=127.25.170.20:32773/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:33703
--ranger_config_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:18.865090 6521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:18.866078 6521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:18.874568 6529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:18.874588 6527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:18.874648 6526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:18.874720 6521 server_base.cc:1034] running on GCE node
I20260808 08:32:18.875411 6521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:18.876506 6521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:18.877668 6521 hybrid_clock.cc:648] HybridClock initialized: now 1786177938877642 us; error 38 us; skew 500 ppm
Aug 08 08:32:18 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177938, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:18.884428 6521 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:32:18.885331 6521 webserver.cc:460] Webserver started at http://127.25.170.62:43535/ using document root <none> and password file <none>
I20260808 08:32:18.885855 6521 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:18.885910 6521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:18.886121 6521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:32:18 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177938, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:18.941468 6521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "dffa97a850b84f8f83916a040a4ecff7"
format_stamp: "Formatted at 2026-08-08 08:32:18 on dist-test-slave-zkpd"
server_key: "644770d4e3cde623e8c989c2e5ee1b33"
server_key_iv: "d7fa13dd7fdaea9f1a5d13d219831c46"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:18.942212 6521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "dffa97a850b84f8f83916a040a4ecff7"
format_stamp: "Formatted at 2026-08-08 08:32:18 on dist-test-slave-zkpd"
server_key: "644770d4e3cde623e8c989c2e5ee1b33"
server_key_iv: "d7fa13dd7fdaea9f1a5d13d219831c46"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:18.947152 6521 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 08:32:18.964483 6536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:18.966272 6521 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:32:18.966434 6521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "dffa97a850b84f8f83916a040a4ecff7"
format_stamp: "Formatted at 2026-08-08 08:32:18 on dist-test-slave-zkpd"
server_key: "644770d4e3cde623e8c989c2e5ee1b33"
server_key_iv: "d7fa13dd7fdaea9f1a5d13d219831c46"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:18.966586 6521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:18.983577 6521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:18.986397 6521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:18.986572 6521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:18.993965 6521 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:33703
I20260808 08:32:18.993973 6589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:33703 every 8 connection(s)
I20260808 08:32:18.994957 6521 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:32:18.997841 6590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:19.000057 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 6521
I20260808 08:32:19.000192 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:32:19.000491 26280 external_mini_cluster.cc:1428] Setting key 4e6d5afec9e7cc09c2e3a3e8cfc43119
I20260808 08:32:19.003796 6590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: Bootstrap starting.
I20260808 08:32:19.006336 6590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:19.007121 6590 log.cc:824] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:19.009464 6590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: No bootstrap required, opened a new log
Aug 08 08:32:19 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:19.012719 6590 raft_consensus.cc:348] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } }
I20260808 08:32:19.012945 6590 raft_consensus.cc:374] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:19.013016 6590 raft_consensus.cc:729] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dffa97a850b84f8f83916a040a4ecff7, State: Initialized, Role: FOLLOWER
I20260808 08:32:19.013460 6590 consensus_queue.cc:260] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } }
I20260808 08:32:19.013613 6590 raft_consensus.cc:388] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:32:19.013723 6590 raft_consensus.cc:482] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:32:19.013837 6590 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:19.014860 6590 raft_consensus.cc:504] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } }
I20260808 08:32:19.015033 6593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:19.001843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42080 (local address 127.25.170.62:33703)
0808 08:32:19.002238 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:19.002253 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:19.002289 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:32:19.002931 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:19.002948 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:19.003271 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:19.003552 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:19.004504 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:19.005472 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:19.006648 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:19.007104 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:19.007253 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:19.010201 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:19.010206 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:19.010219 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:19.010245 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:19.011990 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:19.012440 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:19.012448 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:19.012459 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:19.012564 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:19.012857 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:19.012861 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:19.012862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:19.013324 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:19.013545 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:19.013822 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 08:32:19.014110 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":134,"threads_started":1}
I20260808 08:32:19.015213 6590 leader_election.cc:302] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dffa97a850b84f8f83916a040a4ecff7; no voters:
I20260808 08:32:19.015539 6590 leader_election.cc:288] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:32:19.015627 6595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:32:19.015858 6595 raft_consensus.cc:686] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 1 LEADER]: Becoming Leader. State: Replica: dffa97a850b84f8f83916a040a4ecff7, State: Running, Role: LEADER
I20260808 08:32:19.016218 6595 consensus_queue.cc:237] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } }
I20260808 08:32:19.017738 6590 sys_catalog.cc:564] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:32:19.017848 6597 sys_catalog.cc:455] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dffa97a850b84f8f83916a040a4ecff7. Latest consensus state: current_term: 1 leader_uuid: "dffa97a850b84f8f83916a040a4ecff7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } } }
I20260808 08:32:19.017848 6596 sys_catalog.cc:455] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dffa97a850b84f8f83916a040a4ecff7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } } }
I20260808 08:32:19.017997 6596 sys_catalog.cc:458] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:19.017997 6597 sys_catalog.cc:458] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:19.018380 6599 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:32:19.021472 6599 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:32:19.021935 6590 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 08:32:19.030884 6599 catalog_manager.cc:1347] Generated new cluster ID: e592cc14fb6f49fcaa2ecf7ace55c632
I20260808 08:32:19.031051 6599 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:32:19.062217 6599 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:32:19.063552 6599 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:32:19.072719 6599 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: Generated new TSK 0
I20260808 08:32:19.073531 6599 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:32:19.749162 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:32773/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33703
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:19.912540 6636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:19.912892 6636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:19.912968 6636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:19.918995 6636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:19.919075 6636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:19.919159 6636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:32:19.927284 6636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.25.170.20:32773/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:19.928830 6636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:19.930253 6636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:19.942612 6643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:19.943120 6646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:19.943991 6644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:19.944167 6636 server_base.cc:1034] running on GCE node
I20260808 08:32:19.944566 6636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:19.945240 6636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:19.946414 6636 hybrid_clock.cc:648] HybridClock initialized: now 1786177939946393 us; error 35 us; skew 500 ppm
Aug 08 08:32:19 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177939, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:19.949397 6636 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:32:19.950313 6636 webserver.cc:460] Webserver started at http://127.25.170.1:37077/ using document root <none> and password file <none>
I20260808 08:32:19.950915 6636 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:19.950976 6636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:19.951190 6636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:32:19 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177939, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:19.971980 6636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "7b0b6903db1c4f03b5399a3d0af1a09d"
format_stamp: "Formatted at 2026-08-08 08:32:19 on dist-test-slave-zkpd"
server_key: "cfd954fb24a82a311fdda4c01b8e7df3"
server_key_iv: "f6ead841fd9c433a6b4bd8d333326850"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:19.972908 6636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "7b0b6903db1c4f03b5399a3d0af1a09d"
format_stamp: "Formatted at 2026-08-08 08:32:19 on dist-test-slave-zkpd"
server_key: "cfd954fb24a82a311fdda4c01b8e7df3"
server_key_iv: "f6ead841fd9c433a6b4bd8d333326850"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:19.978376 6636 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:32:20.011977 6654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:20.013868 6636 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.000s
I20260808 08:32:20.014061 6636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "7b0b6903db1c4f03b5399a3d0af1a09d"
format_stamp: "Formatted at 2026-08-08 08:32:19 on dist-test-slave-zkpd"
server_key: "cfd954fb24a82a311fdda4c01b8e7df3"
server_key_iv: "f6ead841fd9c433a6b4bd8d333326850"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:20.014269 6636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:20.034543 6636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:20.038542 6636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:20.038826 6636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:20.039656 6636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:20.040798 6636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:20.040904 6636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:20.041031 6636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:20.041118 6636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:20.061245 6636 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:37527
I20260808 08:32:20.062186 6636 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:32:20.064826 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 6636
I20260808 08:32:20.064946 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:32:20.065285 26280 external_mini_cluster.cc:1428] Setting key e5f37ed10e82001b35f78eea31a457d9
I20260808 08:32:20.063833 6771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:37527 every 8 connection(s)
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177939, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
I20260808 08:32:20.087286 6774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:20.064357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:34405 (local address 127.25.170.62:33703)
0808 08:32:20.071842 (+ 7485us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:20.071851 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:20.072795 (+ 944us) server_negotiation.cc:407] Connection header received
0808 08:32:20.074028 (+ 1233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:20.074032 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:20.074088 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:20.074153 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:20.075870 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.076785 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.078564 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.078921 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.079051 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:20.082644 (+ 3593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:20.082649 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:20.082652 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:20.082773 (+ 121us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:20.084654 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:20.085282 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:20.085286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:20.085287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:20.085408 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:20.085859 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:20.085863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:20.085865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:20.086096 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:20.086171 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:20.086940 (+ 769us) server_negotiation.cc:299] Negotiation successful
0808 08:32:20.087087 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7386,"thread_start_us":115,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:32:20.089246 6775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:20.064891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33703 (local address 127.25.170.1:34405)
0808 08:32:20.072210 (+ 7319us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:20.072507 (+ 297us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:20.073762 (+ 1255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:20.074576 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:20.074585 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:20.074999 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:20.075663 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:20.075682 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.076944 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.076947 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:20.078415 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:20.078426 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.079241 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.079245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:20.079459 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:20.080181 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:20.080203 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:20.082043 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:20.084800 (+ 2757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:20.084805 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:20.084824 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:20.085153 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:20.085534 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:20.085537 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:20.085539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:20.085733 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:20.086262 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:20.086268 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:20.086626 (+ 358us) client_negotiation.cc:769] Sending connection context
0808 08:32:20.087738 (+ 1112us) client_negotiation.cc:240] Negotiation successful
0808 08:32:20.088139 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7064,"thread_start_us":147,"threads_started":1}
I20260808 08:32:20.091068 6772 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33703
I20260808 08:32:20.091328 6772 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:20.091989 6772 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
I20260808 08:32:20.094014 6553 ts_manager.cc:194] Registered new tserver with Master: 7b0b6903db1c4f03b5399a3d0af1a09d (127.25.170.1:37527)
I20260808 08:32:20.095660 6553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:34405
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:32:20.109404 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:32773/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33703
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786177940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 08:32:20.268743 6778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:20.269109 6778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:20.269182 6778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:20.275452 6778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:20.275534 6778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:20.275622 6778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:32:20.283619 6778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.25.170.20:32773/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:20.285259 6778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:20.286770 6778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:20.299680 6784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:20.299710 6787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:20.300324 6785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:20.301395 6778 server_base.cc:1034] running on GCE node
I20260808 08:32:20.302021 6778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:20.302840 6778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:20.304137 6778 hybrid_clock.cc:648] HybridClock initialized: now 1786177940304067 us; error 96 us; skew 500 ppm
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:20.307955 6778 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:32:20.309031 6778 webserver.cc:460] Webserver started at http://127.25.170.2:46835/ using document root <none> and password file <none>
I20260808 08:32:20.309723 6778 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:20.309808 6778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:20.310034 6778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:20.326498 6778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "0c7ac49f5a8e41cd817fa38297671ab5"
format_stamp: "Formatted at 2026-08-08 08:32:20 on dist-test-slave-zkpd"
server_key: "718c4e62c320e1a6cfe42e3f273fbab1"
server_key_iv: "d4c67a0dc933a1586815cc863da31fbd"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:20.327643 6778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "0c7ac49f5a8e41cd817fa38297671ab5"
format_stamp: "Formatted at 2026-08-08 08:32:20 on dist-test-slave-zkpd"
server_key: "718c4e62c320e1a6cfe42e3f273fbab1"
server_key_iv: "d4c67a0dc933a1586815cc863da31fbd"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:20.333123 6778 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 08:32:20.359817 6795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:20.361532 6778 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.002s sys 0.000s
I20260808 08:32:20.361699 6778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "0c7ac49f5a8e41cd817fa38297671ab5"
format_stamp: "Formatted at 2026-08-08 08:32:20 on dist-test-slave-zkpd"
server_key: "718c4e62c320e1a6cfe42e3f273fbab1"
server_key_iv: "d4c67a0dc933a1586815cc863da31fbd"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:20.361868 6778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:20.393676 6778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:20.398558 6778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:20.398779 6778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:20.399577 6778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:20.400739 6778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:20.400812 6778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:20.400874 6778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:20.400908 6778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:20.413262 6778 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:39489
I20260808 08:32:20.413288 6913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:39489 every 8 connection(s)
I20260808 08:32:20.414855 6778 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:32:20.421097 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 6778
I20260808 08:32:20.421255 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:32:20.421573 26280 external_mini_cluster.cc:1428] Setting key 5ba66448e90acb8ce5ce04150d15909b
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
I20260808 08:32:20.444212 6774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:20.417181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:43171 (local address 127.25.170.62:33703)
0808 08:32:20.417323 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:20.417327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:20.418659 (+ 1332us) server_negotiation.cc:407] Connection header received
0808 08:32:20.419699 (+ 1040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:20.419703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:20.419764 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:20.419876 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:20.421333 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.422312 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.423722 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.424061 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.424179 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:20.431114 (+ 6935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:20.431120 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:20.431124 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:20.431155 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:20.433440 (+ 2285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:20.441973 (+ 8533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:20.441979 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:20.441982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:20.442087 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:20.442565 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:20.442571 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:20.442576 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:20.442874 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:20.443005 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:20.443788 (+ 783us) server_negotiation.cc:299] Negotiation successful
0808 08:32:20.444001 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:32:20.446517 6916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:20.417904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33703 (local address 127.25.170.2:43171)
0808 08:32:20.418508 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:20.418552 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:20.419486 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:20.420119 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:20.420128 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:20.420420 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:20.421022 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:20.421132 (+ 110us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.422448 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.422452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:20.423586 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:20.423597 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.424221 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.424226 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:20.426279 (+ 2053us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:20.427059 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:20.427086 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:20.430937 (+ 3851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:20.441346 (+ 10409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:20.441355 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:20.441378 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:20.441809 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:20.442223 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:20.442228 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:20.442231 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:20.442441 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:20.443082 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:20.443092 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:20.443469 (+ 377us) client_negotiation.cc:769] Sending connection context
0808 08:32:20.444845 (+ 1376us) client_negotiation.cc:240] Negotiation successful
0808 08:32:20.445278 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":202,"threads_started":1}
I20260808 08:32:20.448462 6914 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33703
I20260808 08:32:20.448737 6914 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:20.449375 6914 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
I20260808 08:32:20.450560 6553 ts_manager.cc:194] Registered new tserver with Master: 0c7ac49f5a8e41cd817fa38297671ab5 (127.25.170.2:39489)
I20260808 08:32:20.451448 6553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:43171
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:32:20.458936 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:32773/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33703
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:20.605062 6920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:20.605476 6920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:20.605595 6920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
W20260808 08:32:20.612417 6920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:20.612514 6920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:20.612637 6920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:32:20.620414 6920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.25.170.20:32773/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:33703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:20.622066 6920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:20.623536 6920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:20.636161 6926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:20.636652 6925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:20.637449 6928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:20.637804 6920 server_base.cc:1034] running on GCE node
I20260808 08:32:20.638278 6920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:20.639022 6920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:20.640210 6920 hybrid_clock.cc:648] HybridClock initialized: now 1786177940640133 us; error 98 us; skew 500 ppm
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:20.643929 6920 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:32:20.645040 6920 webserver.cc:460] Webserver started at http://127.25.170.3:36159/ using document root <none> and password file <none>
I20260808 08:32:20.645792 6920 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:20.645931 6920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:20.646211 6920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:20.663851 6920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "cb3c3cbfcbc64acba395e0223d5ce779"
format_stamp: "Formatted at 2026-08-08 08:32:20 on dist-test-slave-zkpd"
server_key: "78109795dd82c7f0305b9ef7952acb95"
server_key_iv: "41a6ae9cb59ba12ddbe525af3e4a2784"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:20.665289 6920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "cb3c3cbfcbc64acba395e0223d5ce779"
format_stamp: "Formatted at 2026-08-08 08:32:20 on dist-test-slave-zkpd"
server_key: "78109795dd82c7f0305b9ef7952acb95"
server_key_iv: "41a6ae9cb59ba12ddbe525af3e4a2784"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:20.682502 6920 fs_manager.cc:691] Time spent creating directory manager: real 0.017s user 0.004s sys 0.000s
I20260808 08:32:20.703315 6936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:20.705314 6920 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.001s
I20260808 08:32:20.705446 6920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "cb3c3cbfcbc64acba395e0223d5ce779"
format_stamp: "Formatted at 2026-08-08 08:32:20 on dist-test-slave-zkpd"
server_key: "78109795dd82c7f0305b9ef7952acb95"
server_key_iv: "41a6ae9cb59ba12ddbe525af3e4a2784"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:20.705570 6920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:20.724488 6920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:20.728188 6920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:20.728457 6920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:20.729200 6920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:20.730343 6920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:20.730456 6920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:20.730557 6920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:20.730625 6920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:20.744884 6920 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:42779
I20260808 08:32:20.746098 6920 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:32:20.747262 7052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:42779 every 8 connection(s)
I20260808 08:32:20.752120 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 6920
I20260808 08:32:20.752257 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:32:20.752564 26280 external_mini_cluster.cc:1428] Setting key 523abdbff7a8edda1a71b4ddbf00e1bf
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:20.761520 6774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:20.749083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:46837 (local address 127.25.170.62:33703)
0808 08:32:20.749226 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:20.749230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:20.750073 (+ 843us) server_negotiation.cc:407] Connection header received
0808 08:32:20.751095 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:20.751099 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:20.751162 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:20.751243 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:20.752719 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.753443 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.755086 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.755317 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.755425 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:20.757874 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:20.757877 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:20.757879 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:20.757902 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:20.759355 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:20.759873 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:20.759879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:20.759886 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:20.760014 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:20.760398 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:20.760403 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:20.760404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:20.760587 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:20.760698 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:20.761236 (+ 538us) server_negotiation.cc:299] Negotiation successful
0808 08:32:20.761355 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:32:20.762372 7055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:20.749435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33703 (local address 127.25.170.3:46837)
0808 08:32:20.749910 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:20.749965 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:20.750864 (+ 899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:20.751507 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:20.751514 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:20.751790 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:20.752522 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:20.752543 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.753616 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.753620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:20.754953 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:20.754962 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:20.755476 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:20.755480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:20.755652 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:20.756288 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:20.756331 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:20.757700 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:20.759480 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:20.759486 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:20.759500 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:20.759764 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:20.760118 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:20.760121 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:20.760123 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:20.760289 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:20.760698 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:20.760705 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:20.760965 (+ 260us) client_negotiation.cc:769] Sending connection context
0808 08:32:20.761162 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 08:32:20.761465 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":141,"threads_started":1}
I20260808 08:32:20.763511 7053 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33703
I20260808 08:32:20.763761 7053 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:20.764346 7053 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
I20260808 08:32:20.765550 6553 ts_manager.cc:194] Registered new tserver with Master: cb3c3cbfcbc64acba395e0223d5ce779 (127.25.170.3:42779)
I20260808 08:32:20.766119 6553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:46837
I20260808 08:32:20.767527 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:32:20.768497 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 6636
I20260808 08:32:20.782254 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 6778
I20260808 08:32:20.790002 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 6920
I20260808 08:32:20.801915 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 6521
I20260808 08:32:20.808763 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33703
--webserver_interface=127.25.170.62
--webserver_port=43535
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:33703
--ranger_config_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:32773/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.170.20:32773/kms with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:20.920645 7056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:20.920923 7056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:20.920961 7056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:20.924886 7056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:32:20.924938 7056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:20.924957 7056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:20.924973 7056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:32:20.924988 7056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:32:20.930104 7056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.170.20:32773/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:33703
--ranger_config_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=43535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:20.931016 7056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:20.932010 7056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:20.940315 7064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:20.940322 7062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:20.940392 7056 server_base.cc:1034] running on GCE node
W20260808 08:32:20.940330 7061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:20.941143 7056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:20.942118 7056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:20.943277 7056 hybrid_clock.cc:648] HybridClock initialized: now 1786177940943261 us; error 28 us; skew 500 ppm
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:20.945976 7056 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:32:20.946810 7056 webserver.cc:460] Webserver started at http://127.25.170.62:43535/ using document root <none> and password file <none>
I20260808 08:32:20.947326 7056 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:20.947422 7056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:32:20 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177940, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:20.996979 7056 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:32:20.999337 7073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:21.000741 7056 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:32:21.000852 7056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "dffa97a850b84f8f83916a040a4ecff7"
format_stamp: "Formatted at 2026-08-08 08:32:18 on dist-test-slave-zkpd"
server_key: "644770d4e3cde623e8c989c2e5ee1b33"
server_key_iv: "d7fa13dd7fdaea9f1a5d13d219831c46"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:21.001389 7056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:21.026381 7056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:21.029480 7056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:21.029627 7056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:21.036754 7056 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:33703
I20260808 08:32:21.036775 7127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:33703 every 8 connection(s)
I20260808 08:32:21.037822 7056 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:32:21.042061 7128 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:32:21.043660 7128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: Bootstrap starting.
I20260808 08:32:21.046211 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 7056
I20260808 08:32:21.046662 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:32773/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:37527
--local_ip_for_outbound_sockets=127.25.170.1
--tserver_master_addrs=127.25.170.62:33703
--webserver_port=37077
--webserver_interface=127.25.170.1
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.170.20:32773/kms with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:32:21.060504 7128 log.cc:824] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:21.067082 7128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:32:21.067492 7128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: Bootstrap complete.
I20260808 08:32:21.071589 7128 raft_consensus.cc:348] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } }
I20260808 08:32:21.072052 7128 raft_consensus.cc:729] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dffa97a850b84f8f83916a040a4ecff7, State: Initialized, Role: FOLLOWER
I20260808 08:32:21.072593 7128 consensus_queue.cc:260] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } }
I20260808 08:32:21.072741 7128 raft_consensus.cc:388] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:32:21.072830 7128 raft_consensus.cc:482] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:32:21.072932 7128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:32:21.074801 7128 raft_consensus.cc:504] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } }
I20260808 08:32:21.075140 7128 leader_election.cc:302] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dffa97a850b84f8f83916a040a4ecff7; no voters:
I20260808 08:32:21.075479 7128 leader_election.cc:288] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:32:21.075570 7132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:32:21.075834 7132 raft_consensus.cc:686] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [term 2 LEADER]: Becoming Leader. State: Replica: dffa97a850b84f8f83916a040a4ecff7, State: Running, Role: LEADER
I20260808 08:32:21.076196 7132 consensus_queue.cc:237] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } }
I20260808 08:32:21.076761 7128 sys_catalog.cc:564] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:32:21.077133 7132 sys_catalog.cc:455] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dffa97a850b84f8f83916a040a4ecff7. Latest consensus state: current_term: 2 leader_uuid: "dffa97a850b84f8f83916a040a4ecff7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } } }
I20260808 08:32:21.077245 7132 sys_catalog.cc:458] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:21.077661 7133 sys_catalog.cc:455] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "dffa97a850b84f8f83916a040a4ecff7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dffa97a850b84f8f83916a040a4ecff7" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33703 } } }
I20260808 08:32:21.077824 7133 sys_catalog.cc:458] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7 [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:21.078126 7136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:32:21.079108 7128 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 08:32:21.085196 7136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:32:21.086072 7136 catalog_manager.cc:1259] Loaded cluster ID: e592cc14fb6f49fcaa2ecf7ace55c632
I20260808 08:32:21.086179 7136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:32:21.088768 7136 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:32:21.089526 7136 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: Loaded TSK: 0
I20260808 08:32:21.090857 7136 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:32:21.199455 7130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:21.199846 7130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:21.199942 7130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:21.206005 7130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:21.206090 7130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:21.206188 7130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:32:21.214311 7130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.170.20:32773/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:37527
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=37077
--tserver_master_addrs=127.25.170.62:33703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:21.215852 7130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:21.217330 7130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:21.229836 7168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:21.229868 7167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:21.230391 7170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:21.231004 7130 server_base.cc:1034] running on GCE node
I20260808 08:32:21.231447 7130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:21.232290 7130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:21.233454 7130 hybrid_clock.cc:648] HybridClock initialized: now 1786177941233420 us; error 51 us; skew 500 ppm
Aug 08 08:32:21 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:21.236990 7130 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:32:21.238059 7130 webserver.cc:460] Webserver started at http://127.25.170.1:37077/ using document root <none> and password file <none>
I20260808 08:32:21.238790 7130 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:21.238909 7130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:32:21 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:21.260123 7130 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:32:21.264649 7179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:21.266167 7130 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260808 08:32:21.266294 7130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "7b0b6903db1c4f03b5399a3d0af1a09d"
format_stamp: "Formatted at 2026-08-08 08:32:19 on dist-test-slave-zkpd"
server_key: "cfd954fb24a82a311fdda4c01b8e7df3"
server_key_iv: "f6ead841fd9c433a6b4bd8d333326850"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:21.266875 7130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:21.293411 7130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:21.297091 7130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:21.297328 7130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:21.298132 7130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:21.299185 7130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:21.299283 7130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:21.299372 7130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:21.299427 7130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:21.310421 7130 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:37527
I20260808 08:32:21.310575 7295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:37527 every 8 connection(s)
I20260808 08:32:21.311491 7130 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:32:21.316938 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 7130
I20260808 08:32:21.317361 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:32773/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:39489
--local_ip_for_outbound_sockets=127.25.170.2
--tserver_master_addrs=127.25.170.62:33703
--webserver_port=46835
--webserver_interface=127.25.170.2
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.170.20:32773/kms with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:32:21 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:21.336361 7299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:21.316153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33703 (local address 127.25.170.1:55771)
0808 08:32:21.318173 (+ 2020us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:21.318241 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:21.319534 (+ 1293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:21.321016 (+ 1482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:21.321023 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:21.321353 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:21.321847 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:21.321863 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.323762 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.323769 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:21.325383 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:21.325399 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.326837 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.326844 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:21.327076 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:21.327871 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:21.327919 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:21.329887 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:21.332807 (+ 2920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:21.332813 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:21.332830 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:21.333182 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:21.333586 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:21.333589 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:21.333591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:21.333769 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:21.334550 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:21.334556 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:21.334835 (+ 279us) client_negotiation.cc:769] Sending connection context
0808 08:32:21.335013 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 08:32:21.335336 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1808,"thread_start_us":119,"threads_started":1}
I20260808 08:32:21.338395 7298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:21.316000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:55771 (local address 127.25.170.62:33703)
0808 08:32:21.317859 (+ 1859us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:21.317886 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:21.318401 (+ 515us) server_negotiation.cc:407] Connection header received
0808 08:32:21.320075 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:21.320093 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:21.320541 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:21.320937 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:21.322016 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.323571 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.325549 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.326388 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.326579 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:21.330138 (+ 3559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:21.330146 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:21.330166 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:21.330207 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:21.332651 (+ 2444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:21.333334 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:21.333340 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:21.333346 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:21.333480 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:21.333879 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:21.333883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:21.333885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:21.334366 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:21.334495 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:21.336893 (+ 2398us) server_negotiation.cc:299] Negotiation successful
0808 08:32:21.337412 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1680,"thread_start_us":114,"threads_started":1}
I20260808 08:32:21.341236 7296 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33703
I20260808 08:32:21.341526 7296 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:21.342073 7296 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
W20260808 08:32:21.344398 7296 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:33703 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:32:21.344517 7296 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:21.344673 7296 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
I20260808 08:32:21.345613 7296 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:21.345785 7296 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
W20260808 08:32:21.346658 7296 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:32:21.456218 7300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:21.456533 7300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:21.456602 7300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:21.462543 7300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:21.462656 7300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:21.462752 7300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:32:21.470330 7300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.170.20:32773/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:39489
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=46835
--tserver_master_addrs=127.25.170.62:33703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:21.471815 7300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:21.473273 7300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:21.484184 7307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:21.484441 7306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:21.484184 7309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:21.484661 7300 server_base.cc:1034] running on GCE node
I20260808 08:32:21.485201 7300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:21.485868 7300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:21.487047 7300 hybrid_clock.cc:648] HybridClock initialized: now 1786177941487018 us; error 42 us; skew 500 ppm
Aug 08 08:32:21 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:21.489935 7300 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:32:21.490799 7300 webserver.cc:460] Webserver started at http://127.25.170.2:46835/ using document root <none> and password file <none>
I20260808 08:32:21.491360 7300 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:21.491433 7300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:32:21 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:21.511801 7300 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:32:21.515383 7317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:21.517177 7300 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 08:32:21.517379 7300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "0c7ac49f5a8e41cd817fa38297671ab5"
format_stamp: "Formatted at 2026-08-08 08:32:20 on dist-test-slave-zkpd"
server_key: "718c4e62c320e1a6cfe42e3f273fbab1"
server_key_iv: "d4c67a0dc933a1586815cc863da31fbd"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:21.518211 7300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:21.538380 7300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:21.542013 7300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:21.542256 7300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:21.543067 7300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:21.544224 7300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:21.544289 7300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:21.544353 7300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:21.544385 7300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:21.560813 7300 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:39489
I20260808 08:32:21.560932 7433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:39489 every 8 connection(s)
I20260808 08:32:21.562142 7300 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:32:21.569645 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 7300
I20260808 08:32:21.570195 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.170.20:32773/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:42779
--local_ip_for_outbound_sockets=127.25.170.3
--tserver_master_addrs=127.25.170.62:33703
--webserver_port=36159
--webserver_interface=127.25.170.3
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.170.20:32773/kms with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:32:21 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:21.577628 7298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:21.564089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:59853 (local address 127.25.170.62:33703)
0808 08:32:21.564220 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:21.564224 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:21.565189 (+ 965us) server_negotiation.cc:407] Connection header received
0808 08:32:21.566224 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:21.566228 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:21.566290 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:21.566399 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:21.567465 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.568055 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.569173 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.569456 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.569568 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:21.572785 (+ 3217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:21.572790 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:21.572794 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:21.572829 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:21.574730 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:21.575399 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:21.575405 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:21.575410 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:21.575504 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:21.576003 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:21.576009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:21.576014 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:21.576273 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:21.576376 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:21.577181 (+ 805us) server_negotiation.cc:299] Negotiation successful
0808 08:32:21.577345 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:32:21.579874 7436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:21.564540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33703 (local address 127.25.170.2:59853)
0808 08:32:21.565035 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:21.565087 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:21.566008 (+ 921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:21.566581 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:21.566588 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:21.566855 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:21.567313 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:21.567326 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.568181 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.568185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:21.569039 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:21.569048 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.569753 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.569758 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:21.569963 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:21.570670 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:21.570696 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:21.572570 (+ 1874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:21.574870 (+ 2300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:21.574878 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:21.574896 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:21.575262 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:21.575625 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:21.575631 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:21.575636 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:21.575847 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:21.576472 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:21.576481 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:21.576819 (+ 338us) client_negotiation.cc:769] Sending connection context
0808 08:32:21.578233 (+ 1414us) client_negotiation.cc:240] Negotiation successful
0808 08:32:21.578623 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":145,"threads_started":1}
I20260808 08:32:21.581247 7434 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33703
I20260808 08:32:21.581485 7434 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:21.581988 7434 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
W20260808 08:32:21.583693 7434 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:33703 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:32:21.583839 7434 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:21.584038 7434 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
I20260808 08:32:21.584913 7434 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:21.585078 7434 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
W20260808 08:32:21.585904 7434 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:32:21.712347 7437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:21.712744 7437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:21.712877 7437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:21.718336 7437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:21.718446 7437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:21.718554 7437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:32:21.725819 7437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.170.20:32773/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:42779
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=36159
--tserver_master_addrs=127.25.170.62:33703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:21.726953 7437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:21.728091 7437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:21.740100 7444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:21.740305 7443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:21.740387 7446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:21.741022 7437 server_base.cc:1034] running on GCE node
I20260808 08:32:21.741415 7437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:21.742062 7437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:21.743244 7437 hybrid_clock.cc:648] HybridClock initialized: now 1786177941743217 us; error 46 us; skew 500 ppm
Aug 08 08:32:21 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:21.745976 7437 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:32:21.746893 7437 webserver.cc:460] Webserver started at http://127.25.170.3:36159/ using document root <none> and password file <none>
I20260808 08:32:21.747463 7437 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:21.747566 7437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:32:21 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:21.765419 7437 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.003s sys 0.000s
I20260808 08:32:21.768679 7454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:21.770423 7437 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:32:21.770560 7437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "cb3c3cbfcbc64acba395e0223d5ce779"
format_stamp: "Formatted at 2026-08-08 08:32:20 on dist-test-slave-zkpd"
server_key: "78109795dd82c7f0305b9ef7952acb95"
server_key_iv: "41a6ae9cb59ba12ddbe525af3e4a2784"
server_key_version: "kuduclusterkey@0"
I20260808 08:32:21.771386 7437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:21.795765 7437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:21.799664 7437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:21.799877 7437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:21.800714 7437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:21.801841 7437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:21.801940 7437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:21.802037 7437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:21.802098 7437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:21.813604 7437 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:42779
I20260808 08:32:21.815184 7437 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:32:21.816918 7575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:42779 every 8 connection(s)
I20260808 08:32:21.819756 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 7437
Aug 08 08:32:21 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177941, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:21.834996 7298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:21.817543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:60329 (local address 127.25.170.62:33703)
0808 08:32:21.817673 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:21.817677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:21.819520 (+ 1843us) server_negotiation.cc:407] Connection header received
0808 08:32:21.821402 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:21.821406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:21.821462 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:21.821514 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:21.823154 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.824008 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.825764 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.826117 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.826194 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:21.830256 (+ 4062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:21.830263 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:21.830266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:21.830298 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:21.832096 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:21.832739 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:21.832742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:21.832744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:21.832831 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:21.833266 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:21.833270 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:21.833271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:21.833495 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:21.833577 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:21.834358 (+ 781us) server_negotiation.cc:299] Negotiation successful
0808 08:32:21.834794 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:32:21.835680 7578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:21.818061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33703 (local address 127.25.170.3:60329)
0808 08:32:21.819345 (+ 1284us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:21.819404 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:21.821119 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:21.821931 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:21.821940 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:21.822307 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:21.822974 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:21.822993 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.824187 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.824191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:21.825620 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:21.825631 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.826414 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.826418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:21.826614 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:21.827280 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:21.827301 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:21.830029 (+ 2728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:21.832238 (+ 2209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:21.832257 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:21.832273 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:21.832613 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:21.832946 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:21.832949 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:21.832951 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:21.833133 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:21.833671 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:21.833678 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:21.834012 (+ 334us) client_negotiation.cc:769] Sending connection context
0808 08:32:21.834252 (+ 240us) client_negotiation.cc:240] Negotiation successful
0808 08:32:21.834594 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1035,"thread_start_us":178,"threads_started":1}
I20260808 08:32:21.837136 7576 heartbeater.cc:347] Connected to a master server at 127.25.170.62:33703
I20260808 08:32:21.837395 7576 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:21.837740 7580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:21.820476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50102 (local address 127.25.170.62:33703)
0808 08:32:21.827445 (+ 6969us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:21.827449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:21.827461 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:32:21.827495 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:21.827498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:21.827540 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:21.827618 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:21.829437 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.830249 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.831574 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:21.831950 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:21.832051 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:21.833556 (+ 1505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:21.833560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:21.833562 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:21.833591 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:21.835371 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:21.835982 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:21.835985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:21.835986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:21.836100 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:21.836753 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:21.836756 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:21.836758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:21.836981 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:21.837177 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:21.837468 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 08:32:21.837583 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6896,"thread_start_us":114,"threads_started":1}
I20260808 08:32:21.837941 7576 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
W20260808 08:32:21.839646 7576 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:33703 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:32:21.839767 7576 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:21.839988 7576 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
I20260808 08:32:21.840842 7576 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:21.840979 7576 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
W20260808 08:32:21.841723 7576 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 08:32:22 dist-test-slave-zkpd krb5kdc[6056](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786177942, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:22.346889 7296 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:22.347182 7296 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
I20260808 08:32:22.348413 7090 ts_manager.cc:194] Registered new tserver with Master: 7b0b6903db1c4f03b5399a3d0af1a09d (127.25.170.1:37527)
I20260808 08:32:22.350134 7090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:55771
I20260808 08:32:22.586114 7434 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:22.586417 7434 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
I20260808 08:32:22.587152 7091 ts_manager.cc:194] Registered new tserver with Master: 0c7ac49f5a8e41cd817fa38297671ab5 (127.25.170.2:39489)
I20260808 08:32:22.588019 7091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:59853
Aug 08 08:32:22 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177942, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:22.841964 7576 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:22.842319 7576 heartbeater.cc:511] Master 127.25.170.62:33703 requested a full tablet report, sending...
I20260808 08:32:22.843116 7091 ts_manager.cc:194] Registered new tserver with Master: cb3c3cbfcbc64acba395e0223d5ce779 (127.25.170.3:42779)
I20260808 08:32:22.843915 7091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:60329
I20260808 08:32:22.853477 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:32:22.865550 7598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.855242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50110 (local address 127.25.170.62:33703)
0808 08:32:22.855756 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:22.855760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:22.855774 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:32:22.855811 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:22.855814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:22.855859 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:22.856715 (+ 856us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:22.856837 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.857639 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.858917 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.859285 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.859391 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.861137 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:22.861141 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:22.861144 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:22.861172 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:22.863122 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:22.863700 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:22.863704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:22.863706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:22.863799 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:22.864162 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:22.864165 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:22.864167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:22.864406 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:22.865130 (+ 724us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:22.865224 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 08:32:22.865351 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":101,"threads_started":1}
I20260808 08:32:22.869707 7091 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50110:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:32:22.874801 7091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:32:22.900156 7608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.892283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:39489 (local address 127.0.0.1:35122)
0808 08:32:22.894776 (+ 2493us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:22.894788 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:22.894883 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:22.895667 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:22.895673 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:22.895700 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:22.895841 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.895849 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.897495 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.897500 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.898420 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.898430 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.899575 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.899579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.899692 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.899742 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 08:32:22.899834 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:32:22.899995 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2435,"thread_start_us":91,"threads_started":1}
I20260808 08:32:22.901278 7607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.892560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35122 (local address 127.25.170.2:39489)
0808 08:32:22.894648 (+ 2088us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:22.894655 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:22.894906 (+ 251us) server_negotiation.cc:407] Connection header received
0808 08:32:22.895009 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:22.895015 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:22.895244 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:22.896053 (+ 809us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:22.896217 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.897365 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.898553 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.899427 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.900814 (+ 1387us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.900963 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:22.901015 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 08:32:22.901124 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1982,"thread_start_us":64,"threads_started":1}
I20260808 08:32:22.904783 7604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.893444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:37527 (local address 127.0.0.1:48836)
0808 08:32:22.895266 (+ 1822us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:22.895290 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:22.895386 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:22.896905 (+ 1519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:22.896908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:22.896925 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:22.897016 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.897022 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.900990 (+ 3968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.900994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.902236 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.902248 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.904363 (+ 2115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.904366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.904458 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.904483 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:32:22.904546 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 08:32:22.904610 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1762,"thread_start_us":135,"threads_started":1}
I20260808 08:32:22.905118 7606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.891451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:42779 (local address 127.0.0.1:47112)
0808 08:32:22.894190 (+ 2739us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:22.894237 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:22.894376 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:22.897141 (+ 2765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:22.897144 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:22.897157 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:22.897226 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.897230 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.902569 (+ 5339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.902572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.903630 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.903642 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.904761 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.904765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.904862 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.904885 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:32:22.904936 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 08:32:22.904998 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2561,"thread_start_us":118,"threads_started":1}
I20260808 08:32:22.904647 7364 tablet_service.cc:1467] Processing CreateTablet for tablet f6b81330d81e4c52989eb551d7e90fe6 (DEFAULT_TABLE table=test-table [id=b320f212da5e46718c67bdd2db56b64e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:22.905793 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.893605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48836 (local address 127.25.170.1:37527)
0808 08:32:22.895110 (+ 1505us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:22.895116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:22.895480 (+ 364us) server_negotiation.cc:407] Connection header received
0808 08:32:22.896186 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:22.896198 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:22.896405 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:22.896552 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:22.899653 (+ 3101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.900856 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.902577 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.904125 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.904286 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.905499 (+ 1213us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:22.905558 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 08:32:22.905653 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1402,"thread_start_us":109,"threads_started":1}
I20260808 08:32:22.905897 7364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6b81330d81e4c52989eb551d7e90fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:22.905959 7605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.891566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47112 (local address 127.25.170.3:42779)
0808 08:32:22.896481 (+ 4915us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:22.896488 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:22.896511 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:32:22.896584 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:22.896589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:22.896768 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:22.897533 (+ 765us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:22.897677 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.902449 (+ 4772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.903787 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.904590 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.905515 (+ 925us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.905666 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:22.905718 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 08:32:22.905815 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4807,"thread_start_us":63,"threads_started":1}
I20260808 08:32:22.908830 7489 tablet_service.cc:1467] Processing CreateTablet for tablet f6b81330d81e4c52989eb551d7e90fe6 (DEFAULT_TABLE table=test-table [id=b320f212da5e46718c67bdd2db56b64e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:22.908850 7229 tablet_service.cc:1467] Processing CreateTablet for tablet f6b81330d81e4c52989eb551d7e90fe6 (DEFAULT_TABLE table=test-table [id=b320f212da5e46718c67bdd2db56b64e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:22.909868 7229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6b81330d81e4c52989eb551d7e90fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:22.909895 7489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6b81330d81e4c52989eb551d7e90fe6. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:32:22 dist-test-slave-zkpd krb5kdc[6056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177942, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for HTTP/127.25.170.20@KRBTEST.COM
I20260808 08:32:22.915678 7610 tablet_bootstrap.cc:492] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5: Bootstrap starting.
I20260808 08:32:22.918105 7610 tablet_bootstrap.cc:654] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:22.918568 7611 tablet_bootstrap.cc:492] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d: Bootstrap starting.
I20260808 08:32:22.919070 7610 log.cc:824] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:22.920773 7611 tablet_bootstrap.cc:654] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:22.923936 7611 log.cc:824] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:22.924088 7610 tablet_bootstrap.cc:492] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5: No bootstrap required, opened a new log
I20260808 08:32:22.924808 7612 tablet_bootstrap.cc:492] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: Bootstrap starting.
I20260808 08:32:22.927012 7612 tablet_bootstrap.cc:654] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:22.928802 7612 log.cc:824] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:22.930505 7610 ts_tablet_manager.cc:1397] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260808 08:32:22.931504 7611 tablet_bootstrap.cc:492] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d: No bootstrap required, opened a new log
I20260808 08:32:22.931700 7611 ts_tablet_manager.cc:1397] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260808 08:32:22.934170 7610 raft_consensus.cc:348] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } }
I20260808 08:32:22.934432 7610 raft_consensus.cc:374] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:22.935647 7611 raft_consensus.cc:348] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } }
I20260808 08:32:22.935958 7611 raft_consensus.cc:374] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:22.936040 7611 raft_consensus.cc:729] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b0b6903db1c4f03b5399a3d0af1a09d, State: Initialized, Role: FOLLOWER
I20260808 08:32:22.936525 7611 consensus_queue.cc:260] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } }
I20260808 08:32:22.936865 7612 tablet_bootstrap.cc:492] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: No bootstrap required, opened a new log
I20260808 08:32:22.937063 7612 ts_tablet_manager.cc:1397] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260808 08:32:22.937573 7611 ts_tablet_manager.cc:1428] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260808 08:32:22.938019 7296 heartbeater.cc:503] Master 127.25.170.62:33703 was elected leader, sending a full tablet report...
I20260808 08:32:22.941650 7612 raft_consensus.cc:348] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } }
I20260808 08:32:22.941987 7612 raft_consensus.cc:374] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:22.942086 7612 raft_consensus.cc:729] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb3c3cbfcbc64acba395e0223d5ce779, State: Initialized, Role: FOLLOWER
I20260808 08:32:22.942606 7612 consensus_queue.cc:260] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } }
I20260808 08:32:22.943686 7612 ts_tablet_manager.cc:1428] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:32:22.944097 7576 heartbeater.cc:503] Master 127.25.170.62:33703 was elected leader, sending a full tablet report...
I20260808 08:32:22.949379 7610 raft_consensus.cc:729] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7ac49f5a8e41cd817fa38297671ab5, State: Initialized, Role: FOLLOWER
I20260808 08:32:22.950444 7610 consensus_queue.cc:260] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } }
I20260808 08:32:22.953048 7610 ts_tablet_manager.cc:1428] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20260808 08:32:22.953919 7434 heartbeater.cc:503] Master 127.25.170.62:33703 was elected leader, sending a full tablet report...
I20260808 08:32:22.980273 7616 raft_consensus.cc:482] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:22.980520 7616 raft_consensus.cc:504] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } }
I20260808 08:32:22.981963 7616 leader_election.cc:288] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c7ac49f5a8e41cd817fa38297671ab5 (127.25.170.2:39489), cb3c3cbfcbc64acba395e0223d5ce779 (127.25.170.3:42779)
I20260808 08:32:22.984182 7617 raft_consensus.cc:482] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:22.984391 7617 raft_consensus.cc:504] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } }
I20260808 08:32:22.985471 7617 leader_election.cc:288] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c7ac49f5a8e41cd817fa38297671ab5 (127.25.170.2:39489), 7b0b6903db1c4f03b5399a3d0af1a09d (127.25.170.1:37527)
I20260808 08:32:22.991072 7607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.982679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:42469 (local address 127.25.170.2:39489)
0808 08:32:22.982866 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:22.982870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:22.983613 (+ 743us) server_negotiation.cc:407] Connection header received
0808 08:32:22.983755 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:22.983758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:22.983842 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:22.984178 (+ 336us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:22.984731 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.985543 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.987377 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.988052 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.988144 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.988196 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:22.990855 (+ 2659us) server_negotiation.cc:299] Negotiation successful
0808 08:32:22.990939 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 08:32:22.991340 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.986242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:56645 (local address 127.25.170.1:37527)
0808 08:32:22.986345 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:22.986348 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:22.987026 (+ 678us) server_negotiation.cc:407] Connection header received
0808 08:32:22.987196 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:22.987199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:22.987242 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:22.987300 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:22.987727 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.988491 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.990082 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.990660 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.990743 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.990787 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:22.991125 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 08:32:22.991205 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":57}
I20260808 08:32:22.991797 7621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.982206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:39489 (local address 127.25.170.1:42469)
0808 08:32:22.983493 (+ 1287us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:22.983509 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:22.983634 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:22.984406 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:22.984409 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:22.984426 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:22.984573 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.984580 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.985696 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.985700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.987072 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.987085 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.990581 (+ 3496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.990585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.990692 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.990729 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:32:22.991524 (+ 795us) client_negotiation.cc:240] Negotiation successful
0808 08:32:22.991603 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1213,"thread_start_us":129,"threads_started":1}
I20260808 08:32:22.992524 7374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b81330d81e4c52989eb551d7e90fe6" candidate_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" is_pre_election: true
I20260808 08:32:22.992849 7374 raft_consensus.cc:2454] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b0b6903db1c4f03b5399a3d0af1a09d in term 0.
I20260808 08:32:22.993459 7183 leader_election.cc:302] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7ac49f5a8e41cd817fa38297671ab5, 7b0b6903db1c4f03b5399a3d0af1a09d; no voters:
I20260808 08:32:22.993779 7605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.983165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:49685 (local address 127.25.170.3:42779)
0808 08:32:22.983296 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:22.983301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:22.983968 (+ 667us) server_negotiation.cc:407] Connection header received
0808 08:32:22.984197 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:22.984201 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:22.984252 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:22.984301 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:22.988447 (+ 4146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.989212 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.992404 (+ 3192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.993041 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.993135 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.993181 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:22.993553 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 08:32:22.993632 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:32:22.994050 7616 raft_consensus.cc:2781] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:32:22.994141 7616 raft_consensus.cc:482] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:32:22.994163 7622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.985802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:37527 (local address 127.25.170.3:56645)
0808 08:32:22.986959 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:22.986971 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:22.987085 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:22.987445 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:22.987449 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:22.987465 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:22.987607 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.987613 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.988642 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.988645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.989930 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.989941 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.990886 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.990889 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.990984 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.991007 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:32:22.993941 (+ 2934us) client_negotiation.cc:240] Negotiation successful
0808 08:32:22.994023 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1101,"thread_start_us":109,"threads_started":1}
I20260808 08:32:22.994192 7616 raft_consensus.cc:3037] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:22.994737 7250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b81330d81e4c52989eb551d7e90fe6" candidate_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" is_pre_election: true
I20260808 08:32:22.995725 7616 raft_consensus.cc:504] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } }
I20260808 08:32:22.996299 7250 raft_consensus.cc:2379] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb3c3cbfcbc64acba395e0223d5ce779 in current term 1: Already voted for candidate 7b0b6903db1c4f03b5399a3d0af1a09d in this term.
I20260808 08:32:22.996515 7616 leader_election.cc:288] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [CANDIDATE]: Term 1 election: Requested vote from peers 0c7ac49f5a8e41cd817fa38297671ab5 (127.25.170.2:39489), cb3c3cbfcbc64acba395e0223d5ce779 (127.25.170.3:42779)
I20260808 08:32:22.996896 7620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.982503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:42779 (local address 127.25.170.1:49685)
0808 08:32:22.983857 (+ 1354us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:22.983870 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:22.984064 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:22.987238 (+ 3174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:22.987240 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:22.987263 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:22.988312 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.988323 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.989364 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.989367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.992248 (+ 2881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.992260 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.993286 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.993290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.993402 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:22.993425 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:32:22.996673 (+ 3248us) client_negotiation.cc:240] Negotiation successful
0808 08:32:22.996759 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1289,"mutex_wait_us":901,"thread_start_us":141,"threads_started":1}
I20260808 08:32:22.997603 7528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b81330d81e4c52989eb551d7e90fe6" candidate_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" is_pre_election: true
I20260808 08:32:22.997603 7527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b81330d81e4c52989eb551d7e90fe6" candidate_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb3c3cbfcbc64acba395e0223d5ce779"
I20260808 08:32:22.997854 7528 raft_consensus.cc:2454] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b0b6903db1c4f03b5399a3d0af1a09d in term 0.
I20260808 08:32:22.998242 7374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b81330d81e4c52989eb551d7e90fe6" candidate_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7ac49f5a8e41cd817fa38297671ab5"
I20260808 08:32:22.998383 7374 raft_consensus.cc:3037] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:22.999920 7374 raft_consensus.cc:2454] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b0b6903db1c4f03b5399a3d0af1a09d in term 1.
I20260808 08:32:23.000209 7183 leader_election.cc:302] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7ac49f5a8e41cd817fa38297671ab5, 7b0b6903db1c4f03b5399a3d0af1a09d; no voters: cb3c3cbfcbc64acba395e0223d5ce779
I20260808 08:32:23.000584 7616 raft_consensus.cc:2781] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:32:23.000834 7616 raft_consensus.cc:686] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 1 LEADER]: Becoming Leader. State: Replica: 7b0b6903db1c4f03b5399a3d0af1a09d, State: Running, Role: LEADER
I20260808 08:32:23.001205 7616 consensus_queue.cc:237] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } }
I20260808 08:32:23.004393 7623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.985583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:39489 (local address 127.25.170.3:55967)
0808 08:32:22.986655 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:22.986670 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:22.986772 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:22.995040 (+ 8268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:22.995045 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:22.995066 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:22.995178 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.995184 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.996904 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:22.996907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:22.998108 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:22.998117 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:23.003880 (+ 5763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:23.003885 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:23.004009 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:23.004039 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 08:32:23.004098 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 08:32:23.004180 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1001,"thread_start_us":119,"threads_started":1}
I20260808 08:32:23.005614 7624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:22.985965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:55967 (local address 127.25.170.2:39489)
0808 08:32:22.986248 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:22.986256 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:22.994823 (+ 8567us) server_negotiation.cc:407] Connection header received
0808 08:32:22.994874 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:22.994877 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:22.994922 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:22.995286 (+ 364us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:22.995415 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:22.996733 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:23.002926 (+ 6193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:23.003703 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:23.004710 (+ 1007us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:23.004821 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:23.004858 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 08:32:23.004928 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":97,"threads_started":1}
I20260808 08:32:23.005991 7374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6b81330d81e4c52989eb551d7e90fe6" candidate_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" is_pre_election: true
I20260808 08:32:23.006178 7374 raft_consensus.cc:2379] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb3c3cbfcbc64acba395e0223d5ce779 in current term 1: Already voted for candidate 7b0b6903db1c4f03b5399a3d0af1a09d in this term.
I20260808 08:32:23.006699 7458 leader_election.cc:302] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb3c3cbfcbc64acba395e0223d5ce779; no voters: 0c7ac49f5a8e41cd817fa38297671ab5, 7b0b6903db1c4f03b5399a3d0af1a09d
I20260808 08:32:23.007051 7617 raft_consensus.cc:3037] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:23.008153 7617 raft_consensus.cc:2726] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 08:32:23.008919 7091 catalog_manager.cc:5495] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b0b6903db1c4f03b5399a3d0af1a09d (127.25.170.1). New cstate: current_term: 1 leader_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b0b6903db1c4f03b5399a3d0af1a09d" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 37527 } health_report { overall_health: HEALTHY } } }
I20260808 08:32:23.024996 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:23.020039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48838 (local address 127.25.170.1:37527)
0808 08:32:23.020174 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:23.020179 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:23.020193 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:32:23.020324 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:23.020327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:23.020394 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:23.020509 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:32:23.020817 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:23.021544 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:23.022855 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:23.023211 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:23.023320 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:23.023740 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:32:23.024346 (+ 606us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:32:23.024481 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:23.024664 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 08:32:23.024721 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 08:32:23.031860 7528 raft_consensus.cc:1261] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 1 FOLLOWER]: Refusing update from remote peer 7b0b6903db1c4f03b5399a3d0af1a09d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:32:23.031860 7374 raft_consensus.cc:1261] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [term 1 FOLLOWER]: Refusing update from remote peer 7b0b6903db1c4f03b5399a3d0af1a09d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:32:23.032502 7616 consensus_queue.cc:1035] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7ac49f5a8e41cd817fa38297671ab5" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:32:23.033133 7616 consensus_queue.cc:1035] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb3c3cbfcbc64acba395e0223d5ce779" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:32:23.042176 7629 mvcc.cc:205] Tried to move back new op lower bound from 7316184854650277888 to 7316184854536114176. Current Snapshot: MvccSnapshot[applied={T|T < 7316184854650277888}]
I20260808 08:32:23.051798 7628 mvcc.cc:205] Tried to move back new op lower bound from 7316184854650277888 to 7316184854536114176. Current Snapshot: MvccSnapshot[applied={T|T < 7316184854650277888 or (T in {7316184854650277888})}]
I20260808 08:32:23.052304 7630 mvcc.cc:205] Tried to move back new op lower bound from 7316184854650277888 to 7316184854536114176. Current Snapshot: MvccSnapshot[applied={T|T < 7316184854650277888}]
I20260808 08:32:23.053124 7091 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:32:23.053292 7091 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:32:23.055774 7091 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dffa97a850b84f8f83916a040a4ecff7: Sending DeleteTablet for 3 replicas of tablet f6b81330d81e4c52989eb551d7e90fe6
I20260808 08:32:23.056538 7229 tablet_service.cc:1514] Processing DeleteTablet for tablet f6b81330d81e4c52989eb551d7e90fe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:23 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:48836
I20260808 08:32:23.056517 7364 tablet_service.cc:1514] Processing DeleteTablet for tablet f6b81330d81e4c52989eb551d7e90fe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:23 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:35122
I20260808 08:32:23.056540 7489 tablet_service.cc:1514] Processing DeleteTablet for tablet f6b81330d81e4c52989eb551d7e90fe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:23 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:47112
I20260808 08:32:23.057014 7639 tablet_replica.cc:330] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d: stopping tablet replica
I20260808 08:32:23.057310 7639 raft_consensus.cc:2229] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:32:23.057454 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 7130
I20260808 08:32:23.057689 7639 raft_consensus.cc:2258] T f6b81330d81e4c52989eb551d7e90fe6 P 7b0b6903db1c4f03b5399a3d0af1a09d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:32:23.059785 7638 tablet_replica.cc:330] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5: stopping tablet replica
I20260808 08:32:23.060184 7638 raft_consensus.cc:2229] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:32:23.060544 7638 raft_consensus.cc:2258] T f6b81330d81e4c52989eb551d7e90fe6 P 0c7ac49f5a8e41cd817fa38297671ab5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:32:23.068086 7640 tablet_replica.cc:330] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: stopping tablet replica
I20260808 08:32:23.068941 7640 raft_consensus.cc:2229] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:32:23.069862 7640 raft_consensus.cc:2258] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 08:32:23.069904 7074 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:37527 (error 108)
I20260808 08:32:23.070859 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 7300
I20260808 08:32:23.071142 7606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:23.070720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:37527 (local address 127.0.0.1:48842)
0808 08:32:23.070977 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:23.071052 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:37527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
W20260808 08:32:23.071336 7074 catalog_manager.cc:4584] TS 7b0b6903db1c4f03b5399a3d0af1a09d (127.25.170.1:37527): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f6b81330d81e4c52989eb551d7e90fe6: Network error: Client connection negotiation failed: client connection to 127.25.170.1:37527: connect: Connection refused (error 111)
I20260808 08:32:23.074517 7640 ts_tablet_manager.cc:1905] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:32:23.077514 7640 ts_tablet_manager.cc:1918] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:32:23.077672 7640 log.cc:1196] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/f6b81330d81e4c52989eb551d7e90fe6
I20260808 08:32:23.078096 7640 ts_tablet_manager.cc:1939] T f6b81330d81e4c52989eb551d7e90fe6 P cb3c3cbfcbc64acba395e0223d5ce779: Deleting consensus metadata
I20260808 08:32:23.079504 7077 catalog_manager.cc:4841] TS cb3c3cbfcbc64acba395e0223d5ce779 (127.25.170.3:42779): tablet f6b81330d81e4c52989eb551d7e90fe6 (table test-table [id=b320f212da5e46718c67bdd2db56b64e]) successfully deleted
I20260808 08:32:23.082171 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 7437
I20260808 08:32:23.083112 7606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:23.082288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:39489 (local address 127.0.0.1:35126)
0808 08:32:23.082964 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:23.083018 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.2:39489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":600}
I20260808 08:32:23.091343 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 7056
I20260808 08:32:23.099328 26280 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 08:32:23.443971 26280 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 08:32:23.444083 26280 mini_ranger.cc:66] Stopping Ranger...
I20260808 08:32:23.789273 26280 mini_ranger.cc:68] Stopped Ranger
2026-08-08 08:32:23.789 UTC [6087] LOG: received smart shutdown request
2026-08-08 08:32:23.794 UTC [6087] LOG: background worker "logical replication launcher" (PID 6098) exited with exit code 1
2026-08-08 08:32:23.794 UTC [6091] LOG: shutting down
2026-08-08 08:32:23.948 UTC [6087] LOG: database system is shut down
2026-08-08T08:32:23Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48628 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:32:24 dist-test-slave-zkpd krb5kdc[7650](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:32:24 dist-test-slave-zkpd krb5kdc[7650](info): set up 2 sockets
Aug 08 08:32:24 dist-test-slave-zkpd krb5kdc[7650](info): commencing operation
krb5kdc: starting...
W20260808 08:32:25.138195 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:32:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:32:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:32:25.260747 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:43575
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:38617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:43575,127.25.170.61:32933,127.25.170.60:41781
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:25.370538 7663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:25.370826 7663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:25.370904 7663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:25.374919 7663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:32:25.375001 7663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:25.375041 7663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:25.375099 7663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:32:25.375139 7663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:32:25.380354 7663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:43575,127.25.170.61:32933,127.25.170.60:41781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:43575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:25.381362 7663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:25.382342 7663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:25.390527 7669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:25.390523 7668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:25.390765 7663 server_base.cc:1034] running on GCE node
W20260808 08:32:25.390523 7671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:25.391280 7663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:25.392373 7663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:25.393537 7663 hybrid_clock.cc:648] HybridClock initialized: now 1786177945393511 us; error 36 us; skew 500 ppm
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:25.396263 7663 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:32:25.397114 7663 webserver.cc:460] Webserver started at http://127.25.170.62:44711/ using document root <none> and password file <none>
I20260808 08:32:25.397663 7663 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:25.397801 7663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:25.398046 7663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:25.400183 7663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "54ac2c2f9c0745da92c0d268e5c1ec87"
format_stamp: "Formatted at 2026-08-08 08:32:25 on dist-test-slave-zkpd"
server_key: "6d4be69ce054cf08771809c8b1e2bd06"
server_key_iv: "683a50a0897453e363b394540a41756d"
server_key_version: "encryptionkey@0"
I20260808 08:32:25.400768 7663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "54ac2c2f9c0745da92c0d268e5c1ec87"
format_stamp: "Formatted at 2026-08-08 08:32:25 on dist-test-slave-zkpd"
server_key: "6d4be69ce054cf08771809c8b1e2bd06"
server_key_iv: "683a50a0897453e363b394540a41756d"
server_key_version: "encryptionkey@0"
I20260808 08:32:25.404592 7663 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:32:25.407015 7678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:25.408279 7663 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260808 08:32:25.408421 7663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "54ac2c2f9c0745da92c0d268e5c1ec87"
format_stamp: "Formatted at 2026-08-08 08:32:25 on dist-test-slave-zkpd"
server_key: "6d4be69ce054cf08771809c8b1e2bd06"
server_key_iv: "683a50a0897453e363b394540a41756d"
server_key_version: "encryptionkey@0"
I20260808 08:32:25.408542 7663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:25.425212 7663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:25.428207 7663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:25.428414 7663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:25.435748 7663 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:43575
I20260808 08:32:25.435773 7732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:43575 every 8 connection(s)
I20260808 08:32:25.436703 7663 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:32:25.439347 7733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:25.443063 7733 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:32:25.446736 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 7663
I20260808 08:32:25.446875 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:32:25.447166 26280 external_mini_cluster.cc:1428] Setting key 4761ccb6ca7ee5225d3223e29bc8972c
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.61@KRBTEST.COM; defaulting to no policy
I20260808 08:32:25.458128 7736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.445945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37812 (local address 127.25.170.62:43575)
0808 08:32:25.446201 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.446212 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.446257 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:32:25.446964 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.446970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.447148 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.447333 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.448478 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.449343 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.450352 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.450719 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.450888 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.453617 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.453623 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.453632 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.453653 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.455278 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.455852 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.455856 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.455858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.456009 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.456385 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.456388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.456389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.456722 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.456824 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.457199 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.457453 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":162,"thread_start_us":70,"threads_started":1}
I20260808 08:32:25.458112 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.445244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:43575 (local address 127.0.0.1:37812)
0808 08:32:25.445683 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.445724 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:25.446597 (+ 873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:25.447673 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:25.447677 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:25.448085 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:25.448334 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.448347 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.449489 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.449498 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.450222 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.450231 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.450875 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.450879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.450973 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.451600 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:25.451615 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:25.453469 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:25.455410 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.455422 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.455433 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.455747 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.456103 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.456109 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.456112 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.456282 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.456840 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:25.456845 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:25.456967 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 08:32:25.457098 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 08:32:25.457381 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":111,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.61@KRBTEST.COM" created.
I20260808 08:32:25.462419 7733 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:32:25.463702 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.463332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59194)
0808 08:32:25.463523 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.463615 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 08:32:25.463989 7680 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
I20260808 08:32:25.464864 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.464652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59198)
0808 08:32:25.464740 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.464800 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 08:32:25.465092 7733 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.61:32933: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab.
Entry for principal kudu/127.25.170.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab.
I20260808 08:32:25.478525 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.61:32933
--webserver_interface=127.25.170.61
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab
--principal=kudu/127.25.170.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:38617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:43575,127.25.170.61:32933,127.25.170.60:41781
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:32:25.514321 7733 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } attempt: 1
I20260808 08:32:25.515157 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.514870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59206)
0808 08:32:25.515018 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.515081 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 08:32:25.515993 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.515744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59218)
0808 08:32:25.515852 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.515940 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:32:25.516129 7733 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.61:32933: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
I20260808 08:32:25.584312 7733 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } attempt: 2
I20260808 08:32:25.585168 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.584869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59226)
0808 08:32:25.585025 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.585091 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 08:32:25.585942 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.585708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59234)
0808 08:32:25.585822 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.585877 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 08:32:25.586144 7733 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.61:32933: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
W20260808 08:32:25.590796 7740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:25.591041 7740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:25.591123 7740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:25.595182 7740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:32:25.595233 7740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:25.595252 7740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:25.595311 7740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:32:25.595343 7740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:32:25.600553 7740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:43575,127.25.170.61:32933,127.25.170.60:41781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab
--principal=kudu/127.25.170.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.61:32933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.170.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:25.601511 7740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:25.602497 7740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:25.610764 7746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:25.610770 7745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:25.610764 7748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:25.611196 7740 server_base.cc:1034] running on GCE node
I20260808 08:32:25.611739 7740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:25.612897 7740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:25.614059 7740 hybrid_clock.cc:648] HybridClock initialized: now 1786177945614040 us; error 39 us; skew 500 ppm
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:25.616770 7740 init.cc:377] Logged in from keytab as kudu/127.25.170.61@KRBTEST.COM (short username kudu)
I20260808 08:32:25.617674 7740 webserver.cc:460] Webserver started at http://127.25.170.61:39263/ using document root <none> and password file <none>
I20260808 08:32:25.618219 7740 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:25.618337 7740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:25.618566 7740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:25.620656 7740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/data/instance:
uuid: "826f1172e0664f5b8959463e9750c603"
format_stamp: "Formatted at 2026-08-08 08:32:25 on dist-test-slave-zkpd"
server_key: "d16299458d4c027b511ba2b9ad3de8a8"
server_key_iv: "0c77590a3eb2f3acdc4dc36d91610f2e"
server_key_version: "encryptionkey@0"
I20260808 08:32:25.621214 7740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/wal/instance:
uuid: "826f1172e0664f5b8959463e9750c603"
format_stamp: "Formatted at 2026-08-08 08:32:25 on dist-test-slave-zkpd"
server_key: "d16299458d4c027b511ba2b9ad3de8a8"
server_key_iv: "0c77590a3eb2f3acdc4dc36d91610f2e"
server_key_version: "encryptionkey@0"
I20260808 08:32:25.624796 7740 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:32:25.627068 7755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:25.628310 7740 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:32:25.628448 7740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/wal
uuid: "826f1172e0664f5b8959463e9750c603"
format_stamp: "Formatted at 2026-08-08 08:32:25 on dist-test-slave-zkpd"
server_key: "d16299458d4c027b511ba2b9ad3de8a8"
server_key_iv: "0c77590a3eb2f3acdc4dc36d91610f2e"
server_key_version: "encryptionkey@0"
I20260808 08:32:25.628554 7740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:25.670089 7740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:25.672964 7740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:25.673166 7740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:25.677336 7733 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } attempt: 3
I20260808 08:32:25.678181 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.677865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59244)
0808 08:32:25.678037 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.678106 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 08:32:25.678905 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.678681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59246)
0808 08:32:25.678795 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.678847 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 08:32:25.679036 7733 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.61:32933: Network error: Client connection negotiation failed: client connection to 127.25.170.61:32933: connect: Connection refused (error 111)
I20260808 08:32:25.681219 7740 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.61:32933
I20260808 08:32:25.681241 7808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.61:32933 every 8 connection(s)
I20260808 08:32:25.682183 7740 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
I20260808 08:32:25.684875 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 7740
I20260808 08:32:25.684899 7809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:25.685006 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-1/wal/instance
I20260808 08:32:25.685276 26280 external_mini_cluster.cc:1428] Setting key fb48b36fa76628517b3188938717c282
I20260808 08:32:25.689388 7809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.25.170.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.60@KRBTEST.COM" created.
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:25.703150 7736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.691192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37822 (local address 127.25.170.62:43575)
0808 08:32:25.691307 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.691310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.692387 (+ 1077us) server_negotiation.cc:407] Connection header received
0808 08:32:25.693255 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.693259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.693316 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.693425 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.694566 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.695091 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.696393 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.696633 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.696717 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.699262 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.699267 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.699270 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.699301 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.700837 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.701516 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.701518 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.701520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.701591 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.701985 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.701987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.701989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.702151 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.702224 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.702948 (+ 724us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.703040 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 08:32:25.704358 7812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.691720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:43575 (local address 127.0.0.1:37822)
0808 08:32:25.692238 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.692290 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:25.693064 (+ 774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:25.693587 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:25.693594 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:25.693919 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:25.694426 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.694442 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.695255 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.695258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.696260 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.696271 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.696811 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.696816 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.697061 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.697741 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:25.697757 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:25.699104 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:25.700972 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.700981 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.700997 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.701415 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.701690 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.701693 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.701695 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.701891 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.702263 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:25.702273 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:25.702665 (+ 392us) client_negotiation.cc:769] Sending connection context
0808 08:32:25.702914 (+ 249us) client_negotiation.cc:240] Negotiation successful
0808 08:32:25.703277 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":167,"threads_started":1}
I20260808 08:32:25.705818 7809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab.
Entry for principal kudu/127.25.170.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab.
I20260808 08:32:25.713019 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.60:41781
--webserver_interface=127.25.170.60
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab
--principal=kudu/127.25.170.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:38617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:43575,127.25.170.61:32933,127.25.170.60:41781
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:32:25.714738 7812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.706322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59256)
0808 08:32:25.706430 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.706442 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:25.706501 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:25.707046 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:25.707049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:25.707220 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:25.707290 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.707295 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.708293 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.708299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.708833 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.708841 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.709404 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.709407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.709496 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.709906 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:25.709917 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:25.711074 (+ 1157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:25.713101 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.713107 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.713109 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.713361 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.713643 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.713646 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.713648 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.713794 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.714223 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:25.714226 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:25.714305 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 08:32:25.714436 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 08:32:25.714562 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 08:32:25.714797 7814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.706451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59256 (local address 127.25.170.61:32933)
0808 08:32:25.706730 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.706740 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.706757 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:32:25.706793 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.706797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.706934 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.707067 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.707410 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.708177 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.708945 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.709293 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.709405 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.711197 (+ 1792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.711206 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.711224 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.711243 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.712996 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.713470 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.713475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.713477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.713546 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.713883 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.713886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.713887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.714114 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.714258 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.714532 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.714648 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":77,"threads_started":1}
I20260808 08:32:25.717207 7809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:32:25.717923 7812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.717676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44654)
0808 08:32:25.717801 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.717868 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:32:25.718103 7757 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
I20260808 08:32:25.718978 7812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.718776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44670)
0808 08:32:25.718880 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.718931 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 08:32:25.719110 7809 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:41781: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
I20260808 08:32:25.768344 7809 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } attempt: 1
I20260808 08:32:25.769264 7812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.768963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44682)
0808 08:32:25.769120 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.769184 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 08:32:25.770049 7812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.769834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44684)
0808 08:32:25.769948 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.769999 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 08:32:25.770180 7809 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:41781: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
I20260808 08:32:25.822216 7733 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } attempt: 4
W20260808 08:32:25.825378 7815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:25.825650 7815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:25.825739 7815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
W20260808 08:32:25.830438 7815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:32:25.830520 7815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:25.830571 7815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:25.830633 7815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:32:25.830667 7815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:32:25.831537 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.822804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59266)
0808 08:32:25.823020 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.823037 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:25.823147 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:25.823429 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:25.823433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:25.823623 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:25.823731 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.823736 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.824914 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.824920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.825942 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.825952 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.826451 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.826454 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.826563 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.827104 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:25.827115 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:25.828385 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:25.830046 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.830050 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.830052 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.830247 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.830531 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.830534 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.830536 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.830631 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.831089 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:25.831092 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:25.831175 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 08:32:25.831260 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 08:32:25.831423 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113}
I20260808 08:32:25.831763 7814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.822926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59266 (local address 127.25.170.61:32933)
0808 08:32:25.823056 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.823063 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.823100 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:32:25.823257 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.823261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.823323 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.823412 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.823865 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.824794 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.826064 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.826324 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.826435 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.828537 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.828541 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.828542 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.828578 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.829929 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.830350 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.830354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.830356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.830436 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.830746 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.830750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.830752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.830977 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.831083 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.831362 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.831486 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:32:25.832558 7733 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:32:25.833211 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.832993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44696)
0808 08:32:25.833100 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.833148 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 08:32:25.833813 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.833597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44698)
0808 08:32:25.833706 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.833766 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 08:32:25.833927 7733 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:41781: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
I20260808 08:32:25.836621 7815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:43575,127.25.170.61:32933,127.25.170.60:41781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab
--principal=kudu/127.25.170.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.60:41781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.170.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:25.837632 7815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:25.838328 7809 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } attempt: 2
I20260808 08:32:25.838732 7815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:32:25.838953 7812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.838679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44710)
0808 08:32:25.838839 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.838897 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 08:32:25.839630 7812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.839453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44714)
0808 08:32:25.839545 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.839585 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 08:32:25.839788 7809 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:41781: Network error: Client connection negotiation failed: client connection to 127.25.170.60:41781: connect: Connection refused (error 111)
W20260808 08:32:25.847097 7821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:25.847065 7822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:25.847061 7825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:25.847393 7815 server_base.cc:1034] running on GCE node
I20260808 08:32:25.847971 7815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:25.848999 7815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:25.850183 7815 hybrid_clock.cc:648] HybridClock initialized: now 1786177945850175 us; error 26 us; skew 500 ppm
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:25.852933 7815 init.cc:377] Logged in from keytab as kudu/127.25.170.60@KRBTEST.COM (short username kudu)
I20260808 08:32:25.853735 7815 webserver.cc:460] Webserver started at http://127.25.170.60:38057/ using document root <none> and password file <none>
I20260808 08:32:25.854265 7815 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:25.854354 7815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:25.854579 7815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:25.856575 7815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/data/instance:
uuid: "d5aaf67390bb487692a7fb27afcbd3a5"
format_stamp: "Formatted at 2026-08-08 08:32:25 on dist-test-slave-zkpd"
server_key: "ac76ab7f33e3f4a36f2fd9fdb0537e36"
server_key_iv: "c28c7e5ae0bab2127dcc9e941814cf58"
server_key_version: "encryptionkey@0"
I20260808 08:32:25.857123 7815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/wal/instance:
uuid: "d5aaf67390bb487692a7fb27afcbd3a5"
format_stamp: "Formatted at 2026-08-08 08:32:25 on dist-test-slave-zkpd"
server_key: "ac76ab7f33e3f4a36f2fd9fdb0537e36"
server_key_iv: "c28c7e5ae0bab2127dcc9e941814cf58"
server_key_version: "encryptionkey@0"
I20260808 08:32:25.860641 7815 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:32:25.862903 7833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:25.864228 7815 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:32:25.864367 7815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/wal
uuid: "d5aaf67390bb487692a7fb27afcbd3a5"
format_stamp: "Formatted at 2026-08-08 08:32:25 on dist-test-slave-zkpd"
server_key: "ac76ab7f33e3f4a36f2fd9fdb0537e36"
server_key_iv: "c28c7e5ae0bab2127dcc9e941814cf58"
server_key_version: "encryptionkey@0"
I20260808 08:32:25.864478 7815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:25.879623 7815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:25.883042 7815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:25.883252 7815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:25.890728 7815 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.60:41781
I20260808 08:32:25.890754 7887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.60:41781 every 8 connection(s)
I20260808 08:32:25.891731 7815 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
I20260808 08:32:25.893092 7733 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } attempt: 1
I20260808 08:32:25.894692 7888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:25.898813 7888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:32:25.900082 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 7815
I20260808 08:32:25.900235 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786177786507378-26280-0/minicluster-data/master-2/wal/instance
I20260808 08:32:25.900592 26280 external_mini_cluster.cc:1428] Setting key 865c815519c9de894505f3d79a79541c
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
I20260808 08:32:25.905593 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.893621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44722)
0808 08:32:25.893814 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.893832 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:25.893930 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:25.896074 (+ 2144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:25.896078 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:25.896272 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:25.896392 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.896401 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.897638 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.897643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.898454 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.898465 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.899153 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.899156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.899241 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.899696 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:25.899717 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:25.901232 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:25.903606 (+ 2374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.903609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.903611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.903866 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.904257 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.904260 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.904262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.904366 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.905087 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:25.905091 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:25.905189 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 08:32:25.905309 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 08:32:25.905434 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 08:32:25.906801 7890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.894257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44722 (local address 127.25.170.60:41781)
0808 08:32:25.894657 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.894675 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.894716 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:32:25.895406 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.895422 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.895742 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.896098 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.896538 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.897513 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.898577 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.899027 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.899181 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.901453 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.901462 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.901478 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.901508 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.903455 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.904004 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.904010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.904016 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.904151 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.904468 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.904471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.904473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.904982 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.905113 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.905449 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.905742 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":136,"threads_started":1}
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
I20260808 08:32:25.910876 7733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87: Bootstrap starting.
I20260808 08:32:25.912320 7893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.901541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44734 (local address 127.25.170.60:41781)
0808 08:32:25.902060 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.902069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.902080 (+ 11us) server_negotiation.cc:407] Connection header received
0808 08:32:25.902109 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.902111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.902142 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.902243 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.903104 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.903825 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.904904 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.905317 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.905433 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.909184 (+ 3751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.909187 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.909188 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.909208 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.910630 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.911107 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.911110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.911111 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.911182 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.911461 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.911463 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.911464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.911607 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.911723 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.912016 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.912100 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":458,"thread_start_us":122,"threads_started":1}
I20260808 08:32:25.914507 7733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:25.914637 7736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.900789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37832 (local address 127.25.170.62:43575)
0808 08:32:25.900904 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.900910 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.901316 (+ 406us) server_negotiation.cc:407] Connection header received
0808 08:32:25.901807 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.901811 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.901861 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.901903 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.902879 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.903440 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.904631 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.904833 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.904941 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.907858 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.907862 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.907864 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.907888 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.912583 (+ 4695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.913110 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.913123 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.913124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.913243 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.913557 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.913560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.913562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.913825 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.913917 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.914330 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.914458 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 08:32:25.914664 7891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.900750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:43575 (local address 127.0.0.1:37832)
0808 08:32:25.901192 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.901244 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:25.901405 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:25.902102 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:25.902111 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:25.902564 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:25.902730 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.902741 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.903553 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.903558 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.904511 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.904520 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.905040 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.905043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.905233 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.905934 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:25.905948 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:25.907683 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:25.912682 (+ 4999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.912707 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.912715 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.913028 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.913355 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.913358 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.913360 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.913450 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.913976 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:25.913982 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:25.914097 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 08:32:25.914254 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 08:32:25.914440 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":55,"thread_start_us":110,"threads_started":1}
I20260808 08:32:25.915450 7733 log.cc:824] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:25.915654 7888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:32:25.917871 7733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87: No bootstrap required, opened a new log
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
I20260808 08:32:25.922053 7733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } }
I20260808 08:32:25.922335 7733 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:25.922423 7733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54ac2c2f9c0745da92c0d268e5c1ec87, State: Initialized, Role: FOLLOWER
I20260808 08:32:25.922910 7733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } }
I20260808 08:32:25.923641 7896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } } }
I20260808 08:32:25.923851 7896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:32:25.924336 7733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:32:25.924885 7814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.916321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59274 (local address 127.25.170.61:32933)
0808 08:32:25.916436 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.916441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.916453 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:32:25.916496 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.916499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.916543 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.916630 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.916976 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.917457 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.918491 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.918817 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.918941 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.921205 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.921208 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.921210 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.921233 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.922890 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.923347 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.923350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.923352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.923439 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.923776 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.923780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.923781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.924133 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.924207 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.924605 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.924728 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 08:32:25.925066 7894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.913819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37840 (local address 127.25.170.62:43575)
0808 08:32:25.914108 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.914118 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.914130 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:32:25.914161 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.914163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.914204 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.915244 (+ 1040us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.915340 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.916150 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.917365 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.917714 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.917828 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.920483 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.920487 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.920490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.920515 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.922822 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.923297 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.923300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.923302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.923392 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.923713 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.923718 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.923719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.923962 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.924143 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.924736 (+ 593us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.924878 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":105,"threads_started":1}
I20260808 08:32:25.925323 7891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.916046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:32933 (local address 127.0.0.1:59274)
0808 08:32:25.916329 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.916340 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:25.916391 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:25.916649 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:25.916650 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:25.916770 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:25.916850 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.916855 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.917566 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.917572 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.918357 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.918369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.918986 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.918991 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.919100 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.919540 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:25.919555 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:25.921019 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:25.922989 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.922992 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.922994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.923222 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.923571 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.923574 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.923576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.923668 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.924293 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:25.924296 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:25.924411 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 08:32:25.925024 (+ 613us) client_negotiation.cc:240] Negotiation successful
0808 08:32:25.925157 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191}
I20260808 08:32:25.926396 7888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } has no permanent_uuid. Determining permanent_uuid...
W20260808 08:32:25.930853 7907 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:32:25.930923 7907 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:32:25.930935 7809 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } attempt: 3
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
I20260808 08:32:25.929374 7663 master_runner.cc:186] Error getting master registration for 127.25.170.61:32933: OK, instance_id { permanent_uuid: "826f1172e0664f5b8959463e9750c603" instance_seqno: 1786177945679072 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:32:25.933331 7663 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 08:32:25.933506 7684 tablet.cc:2369] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 08:32:25 dist-test-slave-zkpd krb5kdc[7650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177945, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
I20260808 08:32:25.937350 7814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.926736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59286 (local address 127.25.170.61:32933)
0808 08:32:25.926844 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.926848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.926860 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:32:25.926972 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.926977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.927023 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.927090 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.927920 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.928614 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.929630 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.929969 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.930049 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.933136 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.933141 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.933146 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.933172 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.935031 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.935548 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.935554 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.935559 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.935650 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.936026 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.936031 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.936036 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.936256 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.936466 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.937086 (+ 620us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.937186 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 08:32:25.937705 7891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.926837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44750)
0808 08:32:25.926951 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.926963 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:25.927021 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:25.927330 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:25.927335 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:25.927507 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:25.927613 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.927620 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.928652 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.928658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.929452 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.929461 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.930110 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.930115 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.930185 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.930830 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:25.930845 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:25.932940 (+ 2095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:25.935711 (+ 2771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.935713 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.935716 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.935979 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.936244 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.936246 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.936248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.936343 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.936801 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:25.936807 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:25.936897 (+ 90us) client_negotiation.cc:769] Sending connection context
0808 08:32:25.937005 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 08:32:25.937128 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 08:32:25.938326 7893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.927018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44750 (local address 127.25.170.60:41781)
0808 08:32:25.927113 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.927117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.927130 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:32:25.927164 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.927169 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.927212 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.927278 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.927735 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.928537 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.929582 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.929904 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.929999 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.933086 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.933091 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.933093 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.933117 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.935602 (+ 2485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.936075 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.936081 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.936084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.936152 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.936436 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.936439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.936440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.936679 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.936766 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.937579 (+ 813us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.938169 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 08:32:25.940385 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:32:25.940919 7812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.931294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:41781 (local address 127.0.0.1:44754)
0808 08:32:25.931456 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:25.931471 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:25.931549 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:25.932115 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:25.932118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:25.932296 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:25.932401 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.932408 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.933462 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.933465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.934208 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:25.934218 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.934873 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.934876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:25.934958 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.935401 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:25.935416 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:25.936836 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:25.939182 (+ 2346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.939186 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.939188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.939436 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.939751 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:25.939754 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:25.939756 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:25.939854 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:25.940360 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:25.940363 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:25.940517 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 08:32:25.940626 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 08:32:25.940754 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 08:32:25.941286 7888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5: Bootstrap starting.
I20260808 08:32:25.941562 7890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.931726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44754 (local address 127.25.170.60:41781)
0808 08:32:25.931815 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.931819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.931832 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:32:25.931862 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.931865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.931937 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.932008 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.932585 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.933322 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.934336 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.934645 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.934744 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.936993 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.936996 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.936999 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.937023 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.938769 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.939559 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.939564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.939565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.939646 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.940022 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.940025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.940027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.940223 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.940313 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.941256 (+ 943us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.941420 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 08:32:25.944866 7809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603: Bootstrap starting.
I20260808 08:32:25.947574 7809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:25.951187 7888 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:25.952165 7888 log.cc:824] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:25.952927 7894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.942841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37856 (local address 127.25.170.62:43575)
0808 08:32:25.942957 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.942961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.943299 (+ 338us) server_negotiation.cc:407] Connection header received
0808 08:32:25.943480 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.943484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.943529 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.943583 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.944543 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.945630 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.946907 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.947276 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.947357 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.949248 (+ 1891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.949252 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.949255 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.949281 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.950936 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.951496 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.951499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.951501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.951581 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.951946 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.951950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.951952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.952146 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.952259 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.952655 (+ 396us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.952771 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 08:32:25.953235 7814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.943313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59298 (local address 127.25.170.61:32933)
0808 08:32:25.943403 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.943407 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.944506 (+ 1099us) server_negotiation.cc:407] Connection header received
0808 08:32:25.944666 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.944668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.944707 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.944752 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.945644 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.946339 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.947440 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.947749 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.947856 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.949616 (+ 1760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.949621 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.949625 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.949654 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.951300 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.951804 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.951807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.951809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.951884 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.952305 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.952309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.952310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.952512 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.952614 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.952969 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.953075 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 08:32:25.953135 7809 log.cc:824] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:25.956241 7888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5: No bootstrap required, opened a new log
I20260808 08:32:25.956425 7809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603: No bootstrap required, opened a new log
I20260808 08:32:25.960333 7809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } }
I20260808 08:32:25.960629 7809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:25.960719 7809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 826f1172e0664f5b8959463e9750c603, State: Initialized, Role: FOLLOWER
I20260808 08:32:25.961266 7809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } }
I20260808 08:32:25.961589 7888 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } }
I20260808 08:32:25.961829 7888 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:25.961891 7888 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5aaf67390bb487692a7fb27afcbd3a5, State: Initialized, Role: FOLLOWER
I20260808 08:32:25.962056 7890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:25.943864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44770 (local address 127.25.170.60:41781)
0808 08:32:25.943984 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:25.943988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:25.953560 (+ 9572us) server_negotiation.cc:407] Connection header received
0808 08:32:25.953776 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:25.953779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:25.953827 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:25.953880 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:25.954761 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.955466 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.956490 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:25.956811 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:25.956881 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:25.958505 (+ 1624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:25.958509 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:25.958511 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:25.958535 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:25.960233 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.960706 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.960709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.960711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.960808 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:25.961125 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:25.961128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:25.961130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:25.961320 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:25.961442 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:25.961818 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 08:32:25.961931 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:32:25.962483 7888 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } }
I20260808 08:32:25.963222 7809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:32:25.963728 7888 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:32:25.964293 7918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } } }
I20260808 08:32:25.964507 7918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:32:25.965090 7919 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } } }
I20260808 08:32:25.965274 7919 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 08:32:25.970378 7941 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:32:25.970500 7941 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260808 08:32:25.971715 7935 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:32:25.971791 7935 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:32:25.974628 7815 master_runner.cc:263] No leader master found from master d5aaf67390bb487692a7fb27afcbd3a5
I20260808 08:32:25.974689 7815 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:32:25.975029 7740 master_runner.cc:263] No leader master found from master 826f1172e0664f5b8959463e9750c603
I20260808 08:32:25.975090 7740 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:32:26.026854 7919 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:26.027047 7919 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } }
I20260808 08:32:26.028260 7919 leader_election.cc:288] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54ac2c2f9c0745da92c0d268e5c1ec87 (127.25.170.62:43575), 826f1172e0664f5b8959463e9750c603 (127.25.170.61:32933)
I20260808 08:32:26.028942 7707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" is_pre_election: true
I20260808 08:32:26.029258 7707 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5aaf67390bb487692a7fb27afcbd3a5 in term 0.
I20260808 08:32:26.030040 7782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "826f1172e0664f5b8959463e9750c603" is_pre_election: true
I20260808 08:32:26.030308 7782 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5aaf67390bb487692a7fb27afcbd3a5 in term 0.
I20260808 08:32:26.030783 7837 leader_election.cc:302] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 826f1172e0664f5b8959463e9750c603, d5aaf67390bb487692a7fb27afcbd3a5; no voters:
I20260808 08:32:26.031303 7919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:32:26.031400 7919 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:32:26.031443 7919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:26.032814 7919 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } }
I20260808 08:32:26.033119 7919 leader_election.cc:288] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [CANDIDATE]: Term 1 election: Requested vote from peers 54ac2c2f9c0745da92c0d268e5c1ec87 (127.25.170.62:43575), 826f1172e0664f5b8959463e9750c603 (127.25.170.61:32933)
I20260808 08:32:26.033635 7707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87"
I20260808 08:32:26.033790 7707 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:26.035071 7707 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5aaf67390bb487692a7fb27afcbd3a5 in term 1.
I20260808 08:32:26.035640 7782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "826f1172e0664f5b8959463e9750c603"
I20260808 08:32:26.035792 7782 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:26.037384 7782 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5aaf67390bb487692a7fb27afcbd3a5 in term 1.
I20260808 08:32:26.037757 7837 leader_election.cc:302] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 826f1172e0664f5b8959463e9750c603, d5aaf67390bb487692a7fb27afcbd3a5; no voters:
I20260808 08:32:26.038864 7919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:32:26.039132 7919 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [term 1 LEADER]: Becoming Leader. State: Replica: d5aaf67390bb487692a7fb27afcbd3a5, State: Running, Role: LEADER
I20260808 08:32:26.039521 7919 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } }
I20260808 08:32:26.044898 7919 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5aaf67390bb487692a7fb27afcbd3a5. Latest consensus state: current_term: 1 leader_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } } }
I20260808 08:32:26.045156 7919 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:26.045588 7946 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:32:26.046590 7946 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:32:26.053346 7782 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [term 1 FOLLOWER]: Refusing update from remote peer d5aaf67390bb487692a7fb27afcbd3a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:32:26.054092 7944 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:32:26.057725 7918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5aaf67390bb487692a7fb27afcbd3a5. Latest consensus state: current_term: 1 leader_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } } }
I20260808 08:32:26.057860 7918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:32:26.060889 7707 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [term 1 FOLLOWER]: Refusing update from remote peer d5aaf67390bb487692a7fb27afcbd3a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:32:26.061465 7944 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:32:26.065864 7896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5aaf67390bb487692a7fb27afcbd3a5. Latest consensus state: current_term: 1 leader_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } } }
I20260808 08:32:26.066001 7896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:32:26.073832 7944 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } } }
I20260808 08:32:26.073946 7944 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:26.075129 7896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } } }
I20260808 08:32:26.075245 7896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:32:26.075659 7947 mvcc.cc:205] Tried to move back new op lower bound from 7316184867027468288 to 7316184866988634112. Current Snapshot: MvccSnapshot[applied={T|T < 7316184867027468288}]
I20260808 08:32:26.075848 7950 mvcc.cc:205] Tried to move back new op lower bound from 7316184867027468288 to 7316184866988634112. Current Snapshot: MvccSnapshot[applied={T|T < 7316184867027468288}]
I20260808 08:32:26.076583 7919 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } } }
I20260808 08:32:26.076683 7919 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:26.077584 7918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac2c2f9c0745da92c0d268e5c1ec87" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 43575 } } peers { permanent_uuid: "826f1172e0664f5b8959463e9750c603" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 32933 } } peers { permanent_uuid: "d5aaf67390bb487692a7fb27afcbd3a5" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 41781 } } }
I20260808 08:32:26.077692 7918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:32:26.080581 7948 mvcc.cc:205] Tried to move back new op lower bound from 7316184867027468288 to 7316184866988634112. Current Snapshot: MvccSnapshot[applied={T|T < 7316184867027468288}]
I20260808 08:32:26.083978 7946 catalog_manager.cc:1347] Generated new cluster ID: be89021325074407a763d775e02c9ef5
I20260808 08:32:26.084038 7946 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:32:26.121742 7946 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:32:26.125602 7946 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:32:26.142408 7946 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5aaf67390bb487692a7fb27afcbd3a5: Generated new TSK 0
I20260808 08:32:26.143383 7946 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:32:26.932242 7907 catalog_manager.cc:1259] Loaded cluster ID: be89021325074407a763d775e02c9ef5
I20260808 08:32:26.932327 7907 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87: loading cluster ID for follower catalog manager: success
I20260808 08:32:26.934032 7907 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87: acquiring CA information for follower catalog manager: success
I20260808 08:32:26.935206 7907 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 54ac2c2f9c0745da92c0d268e5c1ec87: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:32:26.973026 7935 catalog_manager.cc:1259] Loaded cluster ID: be89021325074407a763d775e02c9ef5
I20260808 08:32:26.973134 7935 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603: loading cluster ID for follower catalog manager: success
I20260808 08:32:26.974905 7935 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603: acquiring CA information for follower catalog manager: success
I20260808 08:32:26.976151 7935 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 826f1172e0664f5b8959463e9750c603: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:32:27.212844 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 7663
I20260808 08:32:27.222039 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 7740
I20260808 08:32:27.229327 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 7815
2026-08-08T08:32:27Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3160 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:32:27 dist-test-slave-zkpd krb5kdc[7960](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:32:27 dist-test-slave-zkpd krb5kdc[7960](info): set up 2 sockets
Aug 08 08:32:27 dist-test-slave-zkpd krb5kdc[7960](info): commencing operation
krb5kdc: starting...
W20260808 08:32:28.297557 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:32:28 dist-test-slave-zkpd krb5kdc[7960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:32:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:32:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:32:28.422734 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:45101
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:46003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:45101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:28.536796 7973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:28.537034 7973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:28.537071 7973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:28.541083 7973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:32:28.541137 7973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:28.541157 7973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:28.541173 7973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:32:28.541188 7973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:32:28.546222 7973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:45101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:45101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:28.547161 7973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:28.548204 7973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:28.556435 7982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:28.556596 7980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:28.556435 7979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:28.556674 7973 server_base.cc:1034] running on GCE node
I20260808 08:32:28.557338 7973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:28.558382 7973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:28.559568 7973 hybrid_clock.cc:648] HybridClock initialized: now 1786177948559552 us; error 31 us; skew 500 ppm
Aug 08 08:32:28 dist-test-slave-zkpd krb5kdc[7960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177948, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:28.562269 7973 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:32:28.563107 7973 webserver.cc:460] Webserver started at http://127.25.170.62:42693/ using document root <none> and password file <none>
I20260808 08:32:28.563649 7973 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:28.563743 7973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:28.564040 7973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:28.566056 7973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "3f8669a814324fc4a9e0464922dd722d"
format_stamp: "Formatted at 2026-08-08 08:32:28 on dist-test-slave-zkpd"
server_key: "9e9e98d8be38c545ffcb9b1d2272c380"
server_key_iv: "ed5f6c25bcb099276003e2b1135b0643"
server_key_version: "encryptionkey@0"
I20260808 08:32:28.566630 7973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "3f8669a814324fc4a9e0464922dd722d"
format_stamp: "Formatted at 2026-08-08 08:32:28 on dist-test-slave-zkpd"
server_key: "9e9e98d8be38c545ffcb9b1d2272c380"
server_key_iv: "ed5f6c25bcb099276003e2b1135b0643"
server_key_version: "encryptionkey@0"
I20260808 08:32:28.570461 7973 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 08:32:28.572811 7990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:28.573962 7973 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:32:28.574107 7973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "3f8669a814324fc4a9e0464922dd722d"
format_stamp: "Formatted at 2026-08-08 08:32:28 on dist-test-slave-zkpd"
server_key: "9e9e98d8be38c545ffcb9b1d2272c380"
server_key_iv: "ed5f6c25bcb099276003e2b1135b0643"
server_key_version: "encryptionkey@0"
I20260808 08:32:28.574218 7973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:28.597225 7973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:28.599983 7973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:28.600203 7973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:28.607124 7973 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:45101
I20260808 08:32:28.607156 8042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:45101 every 8 connection(s)
I20260808 08:32:28.608084 7973 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:32:28.609668 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 7973
I20260808 08:32:28.609822 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:32:28.610101 26280 external_mini_cluster.cc:1428] Setting key b4b4b2f29412ef6fd5e1b1370858e9aa
I20260808 08:32:28.610983 8043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:28.617568 8043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d: Bootstrap starting.
Aug 08 08:32:28 dist-test-slave-zkpd krb5kdc[7960](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:28.620402 8043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:28.621313 8043 log.cc:824] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:28.623622 8043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d: No bootstrap required, opened a new log
I20260808 08:32:28.624990 8046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:28.611441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44434 (local address 127.25.170.62:45101)
0808 08:32:28.611840 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:28.611862 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:28.611941 (+ 79us) server_negotiation.cc:407] Connection header received
0808 08:32:28.612594 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:28.612622 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:28.612948 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:28.613220 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:28.614214 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:28.615220 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:28.616535 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:28.616991 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:28.617111 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:28.619853 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:28.619860 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:28.619875 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:28.619937 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:28.621892 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:28.622357 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:28.622363 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:28.622369 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:28.622511 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:28.622780 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:28.622784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:28.622785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:28.623321 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:28.623514 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:28.623743 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 08:32:28.624085 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":131,"threads_started":1}
I20260808 08:32:28.628180 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:32:28.628012 8043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8669a814324fc4a9e0464922dd722d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45101 } }
I20260808 08:32:28.628279 8043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:28.628360 8043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8669a814324fc4a9e0464922dd722d, State: Initialized, Role: FOLLOWER
I20260808 08:32:28.628832 8043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8669a814324fc4a9e0464922dd722d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45101 } }
I20260808 08:32:28.628954 8043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:32:28.629033 8043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:32:28.629136 8043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:28.630129 8043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8669a814324fc4a9e0464922dd722d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45101 } }
I20260808 08:32:28.630417 8043 leader_election.cc:302] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f8669a814324fc4a9e0464922dd722d; no voters:
I20260808 08:32:28.630661 8043 leader_election.cc:288] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:32:28.630838 8048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:32:28.631187 8048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [term 1 LEADER]: Becoming Leader. State: Replica: 3f8669a814324fc4a9e0464922dd722d, State: Running, Role: LEADER
I20260808 08:32:28.631548 8048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8669a814324fc4a9e0464922dd722d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45101 } }
I20260808 08:32:28.631866 8043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:32:28.633491 8050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f8669a814324fc4a9e0464922dd722d. Latest consensus state: current_term: 1 leader_uuid: "3f8669a814324fc4a9e0464922dd722d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8669a814324fc4a9e0464922dd722d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45101 } } }
I20260808 08:32:28.633673 8050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:28.633514 8049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f8669a814324fc4a9e0464922dd722d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8669a814324fc4a9e0464922dd722d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45101 } } }
I20260808 08:32:28.633950 8049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:28.634085 8062 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:32:28.637188 8062 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:32:28.642868 8062 catalog_manager.cc:1347] Generated new cluster ID: 6338f7305ab6432ebf3e5704688a9395
I20260808 08:32:28.642936 8062 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:32:28.653672 8062 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:32:28.654858 8062 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:32:28.663286 8062 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f8669a814324fc4a9e0464922dd722d: Generated new TSK 0
I20260808 08:32:28.664022 8062 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:32:28.683789 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 7973
2026-08-08T08:32:28Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1454 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:32:28 dist-test-slave-zkpd krb5kdc[8071](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:32:28 dist-test-slave-zkpd krb5kdc[8071](info): set up 2 sockets
Aug 08 08:32:28 dist-test-slave-zkpd krb5kdc[8071](info): commencing operation
krb5kdc: starting...
W20260808 08:32:29.745954 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:32:29 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177949, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:32:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:32:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:32:29.869241 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40209
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:40209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:29.979592 8085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:29.979842 8085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:29.979880 8085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:29.983878 8085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:32:29.983943 8085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:29.983963 8085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:29.983978 8085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:32:29.983994 8085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:32:29.989137 8085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:40209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:29.990155 8085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:29.991143 8085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:29.999774 8091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:29.999794 8090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:29.999846 8093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:29.999953 8085 server_base.cc:1034] running on GCE node
I20260808 08:32:30.000706 8085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:30.001775 8085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:30.002938 8085 hybrid_clock.cc:648] HybridClock initialized: now 1786177950002905 us; error 44 us; skew 500 ppm
Aug 08 08:32:30 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177950, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:30.010596 8085 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:32:30.011543 8085 webserver.cc:460] Webserver started at http://127.25.170.62:33817/ using document root <none> and password file <none>
I20260808 08:32:30.012182 8085 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:30.012247 8085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:30.012513 8085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:30.014566 8085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "70ecffeafd8024da947105031ef55252"
server_key_iv: "af2592d6dfb3079d6158f8e2017be05b"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.015158 8085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "70ecffeafd8024da947105031ef55252"
server_key_iv: "af2592d6dfb3079d6158f8e2017be05b"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.018916 8085 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:32:30.021322 8100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:30.022563 8085 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:32:30.022701 8085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "70ecffeafd8024da947105031ef55252"
server_key_iv: "af2592d6dfb3079d6158f8e2017be05b"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.022815 8085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:30.041018 8085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:30.044027 8085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:30.044216 8085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:30.051162 8085 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:40209
I20260808 08:32:30.051455 8153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:40209 every 8 connection(s)
I20260808 08:32:30.052181 8085 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:32:30.054843 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:30.055478 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 8085
I20260808 08:32:30.055619 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:32:30.055943 26280 external_mini_cluster.cc:1428] Setting key 5ac6d5c0d7aa0ef0be5b2f2934df7878
I20260808 08:32:30.060660 8154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Bootstrap starting.
I20260808 08:32:30.063597 8154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:30.064639 8154 log.cc:824] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:32:30 dist-test-slave-zkpd krb5kdc[8071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177949, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:30.067408 8154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: No bootstrap required, opened a new log
I20260808 08:32:30.072606 8154 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:30.072928 8154 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:30.073012 8154 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6751c4e0c44d423f9e1b2ee2f3045d8b, State: Initialized, Role: FOLLOWER
I20260808 08:32:30.073541 8157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.057332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40240 (local address 127.25.170.62:40209)
0808 08:32:30.057731 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.057747 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.057794 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:32:30.058401 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.058417 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.058723 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.059053 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:30.059954 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.061701 (+ 1747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.063272 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.063844 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.064101 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.067398 (+ 3297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:30.067405 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:30.067423 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:30.067459 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:30.069635 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:30.070233 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:30.070241 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:30.070248 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:30.070385 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:30.070770 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:30.070773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:30.070775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:30.071166 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:30.071389 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.072086 (+ 697us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.072432 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":131,"threads_started":1}
I20260808 08:32:30.073570 8154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:30.073879 8154 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:32:30.074985 8154 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:32:30.075105 8154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:30.076388 8154 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:30.076785 8154 leader_election.cc:302] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6751c4e0c44d423f9e1b2ee2f3045d8b; no voters:
I20260808 08:32:30.077142 8154 leader_election.cc:288] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:32:30.077240 8159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:32:30.077457 8159 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 1 LEADER]: Becoming Leader. State: Replica: 6751c4e0c44d423f9e1b2ee2f3045d8b, State: Running, Role: LEADER
I20260808 08:32:30.078334 8159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:30.078620 8154 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:32:30.079509 8159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } } }
I20260808 08:32:30.079624 8159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:30.079977 8160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6751c4e0c44d423f9e1b2ee2f3045d8b. Latest consensus state: current_term: 1 leader_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } } }
I20260808 08:32:30.080077 8160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: This master's current role is: LEADER
W20260808 08:32:30.084578 8174 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:32:30.084664 8174 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:32:30.085407 8168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:32:30.086447 8168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:32:30.092985 8168 catalog_manager.cc:1347] Generated new cluster ID: 522fd395799b413bb90a653405aeb69b
I20260808 08:32:30.093077 8168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:32:30.119354 8168 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:32:30.120385 8168 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:32:30.124320 8168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Generated new TSK 0
I20260808 08:32:30.125139 8168 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:32:30.154894 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40209
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:30.268765 8181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:30.269004 8181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:30.269045 8181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:30.273005 8181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:30.273063 8181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:30.273119 8181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:32:30.278431 8181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:30.279497 8181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:30.280647 8181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:30.290334 8187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:30.290445 8181 server_base.cc:1034] running on GCE node
W20260808 08:32:30.290306 8186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:30.290318 8189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:30.291054 8181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:30.291668 8181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:30.292855 8181 hybrid_clock.cc:648] HybridClock initialized: now 1786177950292825 us; error 43 us; skew 500 ppm
Aug 08 08:32:30 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177950, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:30.295732 8181 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:32:30.296671 8181 webserver.cc:460] Webserver started at http://127.25.170.1:45319/ using document root <none> and password file <none>
I20260808 08:32:30.297160 8181 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:30.297216 8181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:30.297384 8181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:30.299279 8181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "36f2b49f388c4c6abdd77578c4eb7b50"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "4f833923b409ffe80ba8b175b40c3b59"
server_key_iv: "da4f490e7ef9c6795aaf2702b03f77d9"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.299793 8181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "36f2b49f388c4c6abdd77578c4eb7b50"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "4f833923b409ffe80ba8b175b40c3b59"
server_key_iv: "da4f490e7ef9c6795aaf2702b03f77d9"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.303272 8181 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:32:30.305615 8196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:30.306797 8181 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:32:30.306932 8181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "36f2b49f388c4c6abdd77578c4eb7b50"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "4f833923b409ffe80ba8b175b40c3b59"
server_key_iv: "da4f490e7ef9c6795aaf2702b03f77d9"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.307031 8181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:30.333554 8181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:30.336901 8181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:30.337107 8181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:30.337695 8181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:30.338524 8181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:30.338570 8181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:30.338637 8181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:30.338670 8181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:30.347743 8181 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:44495
I20260808 08:32:30.347783 8312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:44495 every 8 connection(s)
I20260808 08:32:30.348646 8181 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:32:30.351933 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 8181
I20260808 08:32:30.352100 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:32:30.352458 26280 external_mini_cluster.cc:1428] Setting key 65a913099e23d5c221829b5f9e261173
Aug 08 08:32:30 dist-test-slave-zkpd krb5kdc[8071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177950, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
I20260808 08:32:30.363694 8157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.350417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:57255 (local address 127.25.170.62:40209)
0808 08:32:30.350559 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.350562 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.351387 (+ 825us) server_negotiation.cc:407] Connection header received
0808 08:32:30.353172 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.353175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.353249 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.353338 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:30.354844 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.355378 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.356786 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.357017 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.357130 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.359844 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:30.359851 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:30.359856 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:30.359921 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:30.361608 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:30.362084 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:30.362087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:30.362089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:30.362180 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:30.362524 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:30.362527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:30.362529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:30.362790 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:30.362901 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.363356 (+ 455us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.363473 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:32:30.364468 8315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.350783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:57255)
0808 08:32:30.351217 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:30.351259 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:30.352938 (+ 1679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:30.353493 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:30.353500 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:30.354000 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:30.354669 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.354691 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.355504 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.355511 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.356653 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.356663 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.357169 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.357174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.357344 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.357933 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:30.357948 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:30.359667 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:30.361722 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:30.361726 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:30.361737 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:30.361979 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:30.362282 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:30.362284 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:30.362285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:30.362424 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:30.362902 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:30.362906 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:30.363128 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 08:32:30.363271 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 08:32:30.363520 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":110,"threads_started":1}
I20260808 08:32:30.365739 8313 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40209
I20260808 08:32:30.366014 8313 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:32:30.366604 8313 heartbeater.cc:511] Master 127.25.170.62:40209 requested a full tablet report, sending...
I20260808 08:32:30.368186 8117 ts_manager.cc:194] Registered new tserver with Master: 36f2b49f388c4c6abdd77578c4eb7b50 (127.25.170.1:44495)
I20260808 08:32:30.369261 8117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:57255
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:32:30.382397 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40209
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:30.495438 8318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:30.495693 8318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:30.495736 8318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:30.499714 8318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:30.499773 8318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:30.499831 8318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:32:30.505040 8318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:30.506153 8318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:30.507230 8318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:30.517040 8324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:30.517077 8323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:30.517131 8318 server_base.cc:1034] running on GCE node
W20260808 08:32:30.517315 8326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:30.517740 8318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:30.518373 8318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:30.519574 8318 hybrid_clock.cc:648] HybridClock initialized: now 1786177950519545 us; error 31 us; skew 500 ppm
Aug 08 08:32:30 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177950, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:30.522504 8318 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:32:30.523300 8318 webserver.cc:460] Webserver started at http://127.25.170.2:38827/ using document root <none> and password file <none>
I20260808 08:32:30.523818 8318 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:30.523877 8318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:30.524124 8318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:30.526093 8318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "e73792ec94344e64ad13a2e4e1974b1d"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "c23d4df48e666c89707c3d9d456ea6f2"
server_key_iv: "87a216281323e7a9ea4f3abe91a8b438"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.526684 8318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "e73792ec94344e64ad13a2e4e1974b1d"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "c23d4df48e666c89707c3d9d456ea6f2"
server_key_iv: "87a216281323e7a9ea4f3abe91a8b438"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.530442 8318 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 08:32:30.532725 8334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:30.533932 8318 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:32:30.534054 8318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "e73792ec94344e64ad13a2e4e1974b1d"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "c23d4df48e666c89707c3d9d456ea6f2"
server_key_iv: "87a216281323e7a9ea4f3abe91a8b438"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.534155 8318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:30.568490 8318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:30.571943 8318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:30.572168 8318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:30.572815 8318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:30.573597 8318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:30.573643 8318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:30.573683 8318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:30.573719 8318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:30.583050 8318 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:38701
I20260808 08:32:30.583127 8453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:38701 every 8 connection(s)
I20260808 08:32:30.583994 8318 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:32:30.588726 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 8318
I20260808 08:32:30.588878 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:32:30.589170 26280 external_mini_cluster.cc:1428] Setting key e81767dea44c46a35a5617b76f448cd8
Aug 08 08:32:30 dist-test-slave-zkpd krb5kdc[8071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177950, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:30.599021 8157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.585724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:49919 (local address 127.25.170.62:40209)
0808 08:32:30.585867 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.585870 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.586689 (+ 819us) server_negotiation.cc:407] Connection header received
0808 08:32:30.588144 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.588148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.588209 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.588317 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:30.589891 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.590647 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.592373 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.592586 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.592666 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.595187 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:30.595194 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:30.595200 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:30.595234 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:30.597004 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:30.597511 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:30.597514 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:30.597515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:30.597589 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:30.597933 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:30.597938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:30.597940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:30.598122 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:30.598233 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.598708 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.598847 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:32:30.599967 8456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.586117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:49919)
0808 08:32:30.586546 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:30.586588 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:30.587879 (+ 1291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:30.588536 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:30.588545 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:30.589061 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:30.589713 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.589735 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.590773 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.590777 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.592238 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.592253 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.592735 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.592741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.592972 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.593573 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:30.593589 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:30.595020 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:30.597117 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:30.597121 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:30.597132 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:30.597384 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:30.597684 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:30.597687 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:30.597689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:30.597834 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:30.598232 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:30.598239 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:30.598475 (+ 236us) client_negotiation.cc:769] Sending connection context
0808 08:32:30.598663 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 08:32:30.598971 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":100,"threads_started":1}
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:32:30.601449 8454 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40209
I20260808 08:32:30.601697 8454 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:30.602234 8454 heartbeater.cc:511] Master 127.25.170.62:40209 requested a full tablet report, sending...
I20260808 08:32:30.603355 8117 ts_manager.cc:194] Registered new tserver with Master: e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701)
I20260808 08:32:30.604043 8117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:49919
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:32:30.623075 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40209
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:30.736410 8459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:30.736662 8459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:30.736740 8459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:30.740943 8459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:30.740999 8459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:30.741098 8459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:32:30.746320 8459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:40209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:30.747359 8459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:30.748412 8459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:30.758019 8464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:30.758147 8459 server_base.cc:1034] running on GCE node
W20260808 08:32:30.758041 8467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:30.758034 8465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:30.758687 8459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:30.759241 8459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:30.760428 8459 hybrid_clock.cc:648] HybridClock initialized: now 1786177950760411 us; error 28 us; skew 500 ppm
Aug 08 08:32:30 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177950, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:30.763031 8459 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:32:30.763962 8459 webserver.cc:460] Webserver started at http://127.25.170.3:44071/ using document root <none> and password file <none>
I20260808 08:32:30.764489 8459 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:30.764545 8459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:30.764703 8459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:30.766597 8459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "7ea999dcabcb4847b62d20fc746271a2"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "21f7f54a9beee5902de36a14018c0d1f"
server_key_iv: "d6bf77096a8c71599510686276dfaa09"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.767112 8459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "7ea999dcabcb4847b62d20fc746271a2"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "21f7f54a9beee5902de36a14018c0d1f"
server_key_iv: "d6bf77096a8c71599510686276dfaa09"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.770690 8459 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 08:32:30.772979 8475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:30.774155 8459 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:32:30.774281 8459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "7ea999dcabcb4847b62d20fc746271a2"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "21f7f54a9beee5902de36a14018c0d1f"
server_key_iv: "d6bf77096a8c71599510686276dfaa09"
server_key_version: "encryptionkey@0"
I20260808 08:32:30.774394 8459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:30.785802 8459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:30.788409 8459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:30.788545 8459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:30.789049 8459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:30.789776 8459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:30.789829 8459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:30.789867 8459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:30.789889 8459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:30.799036 8459 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:45201
I20260808 08:32:30.799075 8593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:45201 every 8 connection(s)
I20260808 08:32:30.799849 8459 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
Aug 08 08:32:30 dist-test-slave-zkpd krb5kdc[8071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177950, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:30.810168 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 8459
I20260808 08:32:30.810366 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:32:30.810662 26280 external_mini_cluster.cc:1428] Setting key 0bdddf60b1c4cfba07c9403e2ba62735
I20260808 08:32:30.813149 8157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.801611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:56593 (local address 127.25.170.62:40209)
0808 08:32:30.801741 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.801745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.802521 (+ 776us) server_negotiation.cc:407] Connection header received
0808 08:32:30.803826 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.803828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.803874 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.803997 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:30.805141 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.805658 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.806785 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.806993 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.807066 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.809332 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:30.809335 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:30.809337 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:30.809361 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:30.810863 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:30.811432 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:30.811435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:30.811436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:30.811541 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:30.811976 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:30.811980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:30.811982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:30.812204 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:30.812327 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.812860 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.812984 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:32:30.813867 8596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.801949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:56593)
0808 08:32:30.802355 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:30.802394 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:30.803633 (+ 1239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:30.804170 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:30.804176 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:30.804511 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:30.804970 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.804982 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.805783 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.805786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.806682 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.806692 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.807115 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.807117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.807249 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.807750 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:30.807764 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:30.809182 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:30.810975 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:30.810981 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:30.811000 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:30.811317 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:30.811647 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:30.811651 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:30.811654 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:30.811866 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:30.812336 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:30.812343 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:30.812612 (+ 269us) client_negotiation.cc:769] Sending connection context
0808 08:32:30.812812 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 08:32:30.813111 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":95,"threads_started":1}
I20260808 08:32:30.814924 8594 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40209
I20260808 08:32:30.815109 8594 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:30.815521 8594 heartbeater.cc:511] Master 127.25.170.62:40209 requested a full tablet report, sending...
I20260808 08:32:30.816469 8117 ts_manager.cc:194] Registered new tserver with Master: 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201)
I20260808 08:32:30.817039 8117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:56593
I20260808 08:32:30.824501 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:32:30.833343 8157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.826418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54606 (local address 127.25.170.62:40209)
0808 08:32:30.826529 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.826532 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.826751 (+ 219us) server_negotiation.cc:407] Connection header received
0808 08:32:30.826845 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.826847 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.826881 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.826945 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:30.827596 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.828156 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.828956 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.829169 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.829241 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.830503 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:30.830506 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:30.830508 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:30.830529 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:30.831954 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:30.832302 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:30.832304 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:30.832305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:30.832372 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:30.832591 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:30.832593 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:30.832594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:30.832816 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:30.832947 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.833136 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.833223 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 08:32:30.836100 8117 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54606:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:32:30.839206 8117 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:32:30.853585 8606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.847641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33930 (local address 127.25.170.3:45201)
0808 08:32:30.848420 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.848434 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.848459 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:32:30.848553 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.848559 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.848780 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.849303 (+ 523us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:30.849480 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.850378 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.851848 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.852740 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.852984 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.853162 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.853329 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.853432 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":197,"threads_started":1}
I20260808 08:32:30.853572 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.847443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:45201 (local address 127.0.0.1:33930)
0808 08:32:30.847829 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:30.847882 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:30.848033 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:30.848960 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:30.848966 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:30.848995 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:30.849133 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.849140 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.850528 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.850531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.851695 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.851716 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.852975 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.852979 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.853116 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.853154 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:32:30.853296 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 08:32:30.853432 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":61,"thread_start_us":99,"threads_started":1}
I20260808 08:32:30.853967 8607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.847855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:44495 (local address 127.0.0.1:59044)
0808 08:32:30.848371 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:30.848385 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:30.848474 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:30.849430 (+ 956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:30.849436 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:30.849461 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:30.849566 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.849574 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.851343 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.851347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.852409 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.852419 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.853544 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.853548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.853635 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.853656 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 08:32:30.853730 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 08:32:30.853811 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":2,"thread_start_us":305,"threads_started":1}
I20260808 08:32:30.854315 8610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.848635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57878 (local address 127.25.170.2:38701)
0808 08:32:30.849098 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.849111 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.849135 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:32:30.849208 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.849212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.849348 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.849517 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:30.849890 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.851024 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.852624 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.853399 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.853520 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.853656 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.854048 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.854152 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":143,"threads_started":1}
I20260808 08:32:30.854583 8608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.848230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:38701 (local address 127.0.0.1:57878)
0808 08:32:30.848639 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:30.848651 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:30.848731 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:30.849623 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:30.849625 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:30.849644 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:30.849754 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.849761 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.851193 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.851196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.852497 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.852509 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.853738 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.853741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.853819 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.853838 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 08:32:30.853904 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 08:32:30.853960 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":123,"thread_start_us":95,"threads_started":1}
I20260808 08:32:30.854595 8609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.848226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59044 (local address 127.25.170.1:44495)
0808 08:32:30.848966 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.848981 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.849001 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:32:30.849073 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.849078 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.849282 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.849424 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:30.849815 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.851024 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.852532 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.853399 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.854144 (+ 745us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.854287 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.854343 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.854446 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":137,"threads_started":1}
I20260808 08:32:30.857141 8245 tablet_service.cc:1467] Processing CreateTablet for tablet e71bfc25c23d423dae58f8c5f4574cea (DEFAULT_TABLE table=test-table [id=a24c1e49f27f4e2a8a4e458d296588a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:30.857191 8526 tablet_service.cc:1467] Processing CreateTablet for tablet e71bfc25c23d423dae58f8c5f4574cea (DEFAULT_TABLE table=test-table [id=a24c1e49f27f4e2a8a4e458d296588a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:30.857235 8385 tablet_service.cc:1467] Processing CreateTablet for tablet e71bfc25c23d423dae58f8c5f4574cea (DEFAULT_TABLE table=test-table [id=a24c1e49f27f4e2a8a4e458d296588a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:30.858166 8245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71bfc25c23d423dae58f8c5f4574cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:30.858224 8385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71bfc25c23d423dae58f8c5f4574cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:30.858230 8526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71bfc25c23d423dae58f8c5f4574cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:30.863912 8612 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Bootstrap starting.
I20260808 08:32:30.865471 8613 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Bootstrap starting.
I20260808 08:32:30.866353 8614 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: Bootstrap starting.
I20260808 08:32:30.866606 8612 tablet_bootstrap.cc:654] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:30.867492 8612 log.cc:824] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:30.868001 8613 tablet_bootstrap.cc:654] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:30.868191 8614 tablet_bootstrap.cc:654] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:30.868736 8613 log.cc:824] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:30.869444 8614 log.cc:824] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:30.869714 8612 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: No bootstrap required, opened a new log
I20260808 08:32:30.869941 8612 ts_tablet_manager.cc:1397] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:32:30.870816 8613 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: No bootstrap required, opened a new log
I20260808 08:32:30.871006 8613 ts_tablet_manager.cc:1397] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:32:30.871403 8614 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: No bootstrap required, opened a new log
I20260808 08:32:30.871587 8614 ts_tablet_manager.cc:1397] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:32:30.873373 8612 raft_consensus.cc:348] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:30.873600 8612 raft_consensus.cc:374] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:30.873652 8612 raft_consensus.cc:729] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f2b49f388c4c6abdd77578c4eb7b50, State: Initialized, Role: FOLLOWER
I20260808 08:32:30.874130 8612 consensus_queue.cc:260] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:30.874864 8313 heartbeater.cc:503] Master 127.25.170.62:40209 was elected leader, sending a full tablet report...
I20260808 08:32:30.874977 8613 raft_consensus.cc:348] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:30.875201 8612 ts_tablet_manager.cc:1428] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 08:32:30.875228 8613 raft_consensus.cc:374] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:30.875298 8613 raft_consensus.cc:729] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e73792ec94344e64ad13a2e4e1974b1d, State: Initialized, Role: FOLLOWER
I20260808 08:32:30.875712 8613 consensus_queue.cc:260] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:30.876150 8614 raft_consensus.cc:348] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:30.876384 8614 raft_consensus.cc:374] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:30.876437 8614 raft_consensus.cc:729] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ea999dcabcb4847b62d20fc746271a2, State: Initialized, Role: FOLLOWER
I20260808 08:32:30.876669 8613 ts_tablet_manager.cc:1428] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:32:30.876837 8614 consensus_queue.cc:260] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:30.877029 8454 heartbeater.cc:503] Master 127.25.170.62:40209 was elected leader, sending a full tablet report...
I20260808 08:32:30.877671 8614 ts_tablet_manager.cc:1428] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:32:30.878046 8594 heartbeater.cc:503] Master 127.25.170.62:40209 was elected leader, sending a full tablet report...
I20260808 08:32:30.912329 8622 raft_consensus.cc:482] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:30.912493 8622 raft_consensus.cc:504] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:30.913882 8622 leader_election.cc:288] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701), 36f2b49f388c4c6abdd77578c4eb7b50 (127.25.170.1:44495)
I20260808 08:32:30.917594 8610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.914191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:41271 (local address 127.25.170.2:38701)
0808 08:32:30.914320 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.914325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.914346 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:32:30.914517 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.914521 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.914580 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.914666 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:30.914942 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.915446 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.916602 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.917015 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.917139 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.917211 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.917415 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.917485 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:32:30.917594 8596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.914087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:38701 (local address 127.25.170.3:41271)
0808 08:32:30.914270 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:30.914285 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:30.914405 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:30.914683 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:30.914686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:30.914703 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:30.914827 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.914832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.915576 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.915579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.916476 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.916485 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.917139 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.917143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.917279 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.917298 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 08:32:30.917387 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 08:32:30.917463 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":2}
I20260808 08:32:30.917744 8609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.914220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:47987 (local address 127.25.170.1:44495)
0808 08:32:30.914356 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.914363 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.914596 (+ 233us) server_negotiation.cc:407] Connection header received
0808 08:32:30.914742 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.914745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.914798 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.914884 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:30.915168 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.915681 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.916761 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.917138 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.917314 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.917368 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.917534 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.917600 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:32:30.917919 8623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.914107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:44495 (local address 127.25.170.3:47987)
0808 08:32:30.914491 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:30.914502 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:30.914625 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:30.914898 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:30.914901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:30.914917 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:30.915053 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.915058 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.915802 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.915805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.916629 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:30.916637 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.917278 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.917282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:30.917392 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.917414 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:32:30.917506 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:32:30.917579 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":28,"thread_start_us":125,"threads_started":1}
I20260808 08:32:30.918286 8406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71bfc25c23d423dae58f8c5f4574cea" candidate_uuid: "7ea999dcabcb4847b62d20fc746271a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e73792ec94344e64ad13a2e4e1974b1d" is_pre_election: true
I20260808 08:32:30.918475 8266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71bfc25c23d423dae58f8c5f4574cea" candidate_uuid: "7ea999dcabcb4847b62d20fc746271a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" is_pre_election: true
I20260808 08:32:30.918627 8406 raft_consensus.cc:2454] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ea999dcabcb4847b62d20fc746271a2 in term 0.
I20260808 08:32:30.918781 8266 raft_consensus.cc:2454] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ea999dcabcb4847b62d20fc746271a2 in term 0.
I20260808 08:32:30.919054 8478 leader_election.cc:302] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ea999dcabcb4847b62d20fc746271a2, e73792ec94344e64ad13a2e4e1974b1d; no voters:
I20260808 08:32:30.919335 8622 raft_consensus.cc:2781] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:32:30.919412 8622 raft_consensus.cc:482] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:32:30.919461 8622 raft_consensus.cc:3037] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:30.920629 8622 raft_consensus.cc:504] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:30.920960 8622 leader_election.cc:288] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [CANDIDATE]: Term 1 election: Requested vote from peers e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701), 36f2b49f388c4c6abdd77578c4eb7b50 (127.25.170.1:44495)
I20260808 08:32:30.921348 8266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71bfc25c23d423dae58f8c5f4574cea" candidate_uuid: "7ea999dcabcb4847b62d20fc746271a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f2b49f388c4c6abdd77578c4eb7b50"
I20260808 08:32:30.921348 8406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71bfc25c23d423dae58f8c5f4574cea" candidate_uuid: "7ea999dcabcb4847b62d20fc746271a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e73792ec94344e64ad13a2e4e1974b1d"
I20260808 08:32:30.921483 8266 raft_consensus.cc:3037] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:30.921483 8406 raft_consensus.cc:3037] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:30.922796 8406 raft_consensus.cc:2454] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ea999dcabcb4847b62d20fc746271a2 in term 1.
I20260808 08:32:30.922796 8266 raft_consensus.cc:2454] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ea999dcabcb4847b62d20fc746271a2 in term 1.
I20260808 08:32:30.923094 8476 leader_election.cc:302] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36f2b49f388c4c6abdd77578c4eb7b50, 7ea999dcabcb4847b62d20fc746271a2; no voters:
I20260808 08:32:30.923322 8622 raft_consensus.cc:2781] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:32:30.923550 8622 raft_consensus.cc:686] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 1 LEADER]: Becoming Leader. State: Replica: 7ea999dcabcb4847b62d20fc746271a2, State: Running, Role: LEADER
I20260808 08:32:30.923882 8622 consensus_queue.cc:237] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:30.926942 8117 catalog_manager.cc:5495] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3). New cstate: current_term: 1 leader_uuid: "7ea999dcabcb4847b62d20fc746271a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } health_report { overall_health: UNKNOWN } } }
I20260808 08:32:30.956205 8606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:30.952476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33944 (local address 127.25.170.3:45201)
0808 08:32:30.952640 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:30.952645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:30.952659 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:32:30.952834 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:30.952837 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:30.952897 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:30.953013 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:32:30.953279 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.953798 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.954674 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:30.954904 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:30.955017 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:30.955349 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:32:30.955756 (+ 407us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:32:30.955898 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:30.955978 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 08:32:30.956038 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:32:30.962119 8266 raft_consensus.cc:1261] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Refusing update from remote peer 7ea999dcabcb4847b62d20fc746271a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:32:30.962152 8406 raft_consensus.cc:1261] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 1 FOLLOWER]: Refusing update from remote peer 7ea999dcabcb4847b62d20fc746271a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:32:30.962857 8622 consensus_queue.cc:1035] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:32:30.963066 8624 consensus_queue.cc:1035] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:32:30.970017 8628 mvcc.cc:205] Tried to move back new op lower bound from 7316184887133089792 to 7316184886986727424. Current Snapshot: MvccSnapshot[applied={T|T < 7316184887133089792}]
I20260808 08:32:30.972556 8629 mvcc.cc:205] Tried to move back new op lower bound from 7316184887133089792 to 7316184886986727424. Current Snapshot: MvccSnapshot[applied={T|T < 7316184887133089792 or (T in {7316184887133089792})}]
I20260808 08:32:30.979249 8116 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:32:30.979476 8116 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:32:30.981859 8116 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Sending DeleteTablet for 3 replicas of tablet e71bfc25c23d423dae58f8c5f4574cea
I20260808 08:32:30.982653 8245 tablet_service.cc:1514] Processing DeleteTablet for tablet e71bfc25c23d423dae58f8c5f4574cea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:30 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:59044
I20260808 08:32:30.982653 8385 tablet_service.cc:1514] Processing DeleteTablet for tablet e71bfc25c23d423dae58f8c5f4574cea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:30 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:57878
I20260808 08:32:30.982847 8526 tablet_service.cc:1514] Processing DeleteTablet for tablet e71bfc25c23d423dae58f8c5f4574cea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:30 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:33930
I20260808 08:32:30.983196 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 8181
I20260808 08:32:30.986397 8640 tablet_replica.cc:330] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: stopping tablet replica
I20260808 08:32:30.986771 8640 raft_consensus.cc:2229] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:32:30.987236 8640 raft_consensus.cc:2258] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:32:30.988969 8640 ts_tablet_manager.cc:1905] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:32:30.992720 8640 ts_tablet_manager.cc:1918] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:32:30.992861 8640 log.cc:1196] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/e71bfc25c23d423dae58f8c5f4574cea
I20260808 08:32:30.993149 8638 tablet_replica.cc:330] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: stopping tablet replica
I20260808 08:32:30.993270 8640 ts_tablet_manager.cc:1939] T e71bfc25c23d423dae58f8c5f4574cea P 7ea999dcabcb4847b62d20fc746271a2: Deleting consensus metadata
W20260808 08:32:30.993925 8101 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:44495 (error 108)
I20260808 08:32:30.994143 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 8318
I20260808 08:32:31.000800 8103 catalog_manager.cc:4841] TS 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201): tablet e71bfc25c23d423dae58f8c5f4574cea (table test-table [id=a24c1e49f27f4e2a8a4e458d296588a5]) successfully deleted
I20260808 08:32:31.002300 8608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.001979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:44495 (local address 127.0.0.1:59058)
0808 08:32:31.002133 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:31.002211 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:44495: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 08:32:31.002480 8101 catalog_manager.cc:4584] TS 36f2b49f388c4c6abdd77578c4eb7b50 (127.25.170.1:44495): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e71bfc25c23d423dae58f8c5f4574cea: Network error: Client connection negotiation failed: client connection to 127.25.170.1:44495: connect: Connection refused (error 111)
I20260808 08:32:31.006769 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 8459
I20260808 08:32:31.006884 8608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.006629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:38701 (local address 127.0.0.1:57888)
0808 08:32:31.006742 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:31.006796 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.2:38701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 08:32:31.015020 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 8085
I20260808 08:32:31.022583 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40209
--webserver_interface=127.25.170.62
--webserver_port=33817
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:40209
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:31.135509 8642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:31.135759 8642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:31.135798 8642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:31.140262 8642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:32:31.140316 8642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:31.140334 8642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:31.140352 8642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:32:31.140410 8642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:32:31.145517 8642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:40209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=33817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:31.146585 8642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:31.147645 8642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:31.161880 8652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:31.161895 8650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:31.162124 8642 server_base.cc:1034] running on GCE node
W20260808 08:32:31.161880 8649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:31.162850 8642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:31.164106 8642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:31.165282 8642 hybrid_clock.cc:648] HybridClock initialized: now 1786177951165266 us; error 26 us; skew 500 ppm
Aug 08 08:32:31 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177951, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:31.168267 8642 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:32:31.169250 8642 webserver.cc:460] Webserver started at http://127.25.170.62:33817/ using document root <none> and password file <none>
I20260808 08:32:31.169853 8642 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:31.169955 8642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:31.173949 8642 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:32:31.176222 8659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:31.177497 8642 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:32:31.177645 8642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "70ecffeafd8024da947105031ef55252"
server_key_iv: "af2592d6dfb3079d6158f8e2017be05b"
server_key_version: "encryptionkey@0"
I20260808 08:32:31.178277 8642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:31.189785 8642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:31.193086 8642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:31.193305 8642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:31.200877 8642 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:40209
I20260808 08:32:31.201161 8714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:40209 every 8 connection(s)
I20260808 08:32:31.202009 8642 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:32:31.206604 8715 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:32:31.208436 8715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Bootstrap starting.
I20260808 08:32:31.209215 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 8642
I20260808 08:32:31.209739 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:44495
--local_ip_for_outbound_sockets=127.25.170.1
--tserver_master_addrs=127.25.170.62:40209
--webserver_port=45319
--webserver_interface=127.25.170.1
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:32:31.227787 8715 log.cc:824] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:31.237159 8715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:32:31.237555 8715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Bootstrap complete.
I20260808 08:32:31.241842 8715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:31.242223 8715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6751c4e0c44d423f9e1b2ee2f3045d8b, State: Initialized, Role: FOLLOWER
I20260808 08:32:31.242779 8715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:31.242902 8715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:32:31.242998 8715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:32:31.243115 8715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:32:31.245117 8715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:31.245461 8715 leader_election.cc:302] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6751c4e0c44d423f9e1b2ee2f3045d8b; no voters:
I20260808 08:32:31.245817 8715 leader_election.cc:288] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:32:31.245903 8719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:32:31.246104 8719 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 2 LEADER]: Becoming Leader. State: Replica: 6751c4e0c44d423f9e1b2ee2f3045d8b, State: Running, Role: LEADER
I20260808 08:32:31.246408 8719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:31.247077 8715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:32:31.247340 8719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6751c4e0c44d423f9e1b2ee2f3045d8b. Latest consensus state: current_term: 2 leader_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } } }
I20260808 08:32:31.247458 8719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:31.247808 8723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:32:31.247855 8720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } } }
I20260808 08:32:31.248103 8720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:31.252770 8723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:32:31.253432 8723 catalog_manager.cc:1259] Loaded cluster ID: 522fd395799b413bb90a653405aeb69b
I20260808 08:32:31.253486 8723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:32:31.254581 8723 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 08:32:31.258083 8723 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 08:32:31.262142 8723 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:32:31.262739 8723 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Loaded TSK: 0
I20260808 08:32:31.263659 8723 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:32:31.334950 8717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:31.335234 8717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:31.335309 8717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:31.339238 8717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:31.339323 8717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:31.339416 8717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:32:31.344626 8717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:44495
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=45319
--tserver_master_addrs=127.25.170.62:40209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:31.345620 8717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:31.346625 8717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:31.356272 8743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:31.356266 8744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:31.356348 8746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:31.357414 8717 server_base.cc:1034] running on GCE node
I20260808 08:32:31.357889 8717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:31.358503 8717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:31.359683 8717 hybrid_clock.cc:648] HybridClock initialized: now 1786177951359660 us; error 40 us; skew 500 ppm
Aug 08 08:32:31 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177951, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:31.362830 8717 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:32:31.363704 8717 webserver.cc:460] Webserver started at http://127.25.170.1:45319/ using document root <none> and password file <none>
I20260808 08:32:31.364313 8717 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:31.364387 8717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:31.368300 8717 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:32:31.370510 8753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:31.371795 8717 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:32:31.371968 8717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "36f2b49f388c4c6abdd77578c4eb7b50"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "4f833923b409ffe80ba8b175b40c3b59"
server_key_iv: "da4f490e7ef9c6795aaf2702b03f77d9"
server_key_version: "encryptionkey@0"
I20260808 08:32:31.372514 8717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:31.403750 8717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:31.407270 8717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:31.407485 8717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:31.408181 8717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:31.409273 8762 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 08:32:31.413478 8717 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 08:32:31.413555 8717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260808 08:32:31.413658 8717 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 08:32:31.415361 8717 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 08:32:31.415432 8717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 08:32:31.415700 8762 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Bootstrap starting.
I20260808 08:32:31.426345 8717 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:44495
I20260808 08:32:31.426393 8873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:44495 every 8 connection(s)
I20260808 08:32:31.427317 8717 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:32:31.427845 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 8717
I20260808 08:32:31.428439 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:38701
--local_ip_for_outbound_sockets=127.25.170.2
--tserver_master_addrs=127.25.170.62:40209
--webserver_port=38827
--webserver_interface=127.25.170.2
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:32:31.437562 8762 log.cc:824] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:32:31 dist-test-slave-zkpd krb5kdc[8071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177951, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:31.447058 8762 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:32:31.447216 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.429865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:51151 (local address 127.25.170.62:40209)
0808 08:32:31.432040 (+ 2175us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:31.432078 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:31.432128 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:32:31.432409 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:31.432425 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:31.432826 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:31.433199 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:31.434871 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.436464 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.438160 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.438837 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.439037 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.441582 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:31.441587 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:31.441600 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:31.441628 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:31.443344 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:31.443926 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:31.443934 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:31.443939 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:31.444064 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:31.444467 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:31.444472 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:31.444473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:31.444826 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:31.444980 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:31.446164 (+ 1184us) server_negotiation.cc:299] Negotiation successful
0808 08:32:31.446406 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1964,"thread_start_us":128,"threads_started":1}
I20260808 08:32:31.447497 8762 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Bootstrap complete.
I20260808 08:32:31.448450 8877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.429783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:51151)
0808 08:32:31.430733 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:31.430788 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:31.431567 (+ 779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:31.433345 (+ 1778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:31.433358 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:31.433903 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:31.434615 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.434642 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.436648 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.436651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.438000 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.438014 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.438998 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.439004 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.439195 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.439858 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:31.439875 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:31.441377 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:31.443476 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:31.443482 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:31.443494 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:31.443763 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:31.444181 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:31.444185 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:31.444190 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:31.444367 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:31.444968 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:31.444974 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:31.445220 (+ 246us) client_negotiation.cc:769] Sending connection context
0808 08:32:31.445428 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 08:32:31.447580 (+ 2152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":144,"threads_started":1}
I20260808 08:32:31.449347 8762 ts_tablet_manager.cc:1397] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Time spent bootstrapping tablet: real 0.034s user 0.025s sys 0.008s
I20260808 08:32:31.450677 8874 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40209
I20260808 08:32:31.450910 8874 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:31.451399 8874 heartbeater.cc:511] Master 127.25.170.62:40209 requested a full tablet report, sending...
I20260808 08:32:31.452425 8762 raft_consensus.cc:348] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:31.452914 8762 raft_consensus.cc:729] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f2b49f388c4c6abdd77578c4eb7b50, State: Initialized, Role: FOLLOWER
I20260808 08:32:31.453413 8762 consensus_queue.cc:260] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:31.454097 8677 ts_manager.cc:194] Registered new tserver with Master: 36f2b49f388c4c6abdd77578c4eb7b50 (127.25.170.1:44495)
I20260808 08:32:31.454439 8762 ts_tablet_manager.cc:1428] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:32:31.457736 8677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:51151
I20260808 08:32:31.462301 8874 heartbeater.cc:503] Master 127.25.170.62:40209 was elected leader, sending a full tablet report...
Aug 08 08:32:31 dist-test-slave-zkpd krb5kdc[8071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177951, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:32:31.470182 8882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.457182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59062 (local address 127.25.170.1:44495)
0808 08:32:31.458157 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:31.458168 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:31.458190 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:32:31.458255 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:31.458260 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:31.458454 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:31.458576 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:31.459457 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.460753 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.462247 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.462722 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.462842 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.466578 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:31.466586 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:31.466595 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:31.466618 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:31.468344 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:31.468862 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:31.468866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:31.468867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:31.468945 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:31.469222 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:31.469224 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:31.469226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:31.469455 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:31.469571 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:31.469934 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 08:32:31.470064 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":857,"thread_start_us":118,"threads_started":1}
I20260808 08:32:31.470224 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.457075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:44495 (local address 127.0.0.1:59062)
0808 08:32:31.457684 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:31.457735 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:31.457865 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:31.458740 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:31.458746 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:31.459168 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:31.459295 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.459303 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.460918 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.460922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.462072 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.462085 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.462973 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.462977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.463093 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.464558 (+ 1465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:31.464577 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:31.466414 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:31.468450 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:31.468460 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:31.468465 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:31.468755 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:31.469034 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:31.469037 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:31.469039 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:31.469135 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:31.469589 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:31.469595 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:31.469718 (+ 123us) client_negotiation.cc:769] Sending connection context
0808 08:32:31.469864 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 08:32:31.470053 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":104,"threads_started":1}
I20260808 08:32:31.471576 8805 tablet_service.cc:1514] Processing DeleteTablet for tablet e71bfc25c23d423dae58f8c5f4574cea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:30 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:59062
I20260808 08:32:31.472644 8883 tablet_replica.cc:330] stopping tablet replica
I20260808 08:32:31.472939 8883 raft_consensus.cc:2229] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:32:31.473186 8883 raft_consensus.cc:2258] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:32:31.474167 8883 ts_tablet_manager.cc:1905] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:32:31.478194 8883 ts_tablet_manager.cc:1918] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:32:31.478307 8883 log.cc:1196] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/e71bfc25c23d423dae58f8c5f4574cea
I20260808 08:32:31.478579 8883 ts_tablet_manager.cc:1939] T e71bfc25c23d423dae58f8c5f4574cea P 36f2b49f388c4c6abdd77578c4eb7b50: Deleting consensus metadata
I20260808 08:32:31.480288 8660 catalog_manager.cc:4841] TS 36f2b49f388c4c6abdd77578c4eb7b50 (127.25.170.1:44495): tablet e71bfc25c23d423dae58f8c5f4574cea (table test-table [id=a24c1e49f27f4e2a8a4e458d296588a5]) successfully deleted
W20260808 08:32:31.555939 8878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:31.556172 8878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:31.556213 8878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:31.560276 8878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:31.560328 8878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:31.560382 8878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:32:31.565416 8878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:38701
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=38827
--tserver_master_addrs=127.25.170.62:40209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:31.566363 8878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:31.567302 8878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:31.577209 8893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:31.577224 8890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:31.577216 8891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:31.577504 8878 server_base.cc:1034] running on GCE node
I20260808 08:32:31.578007 8878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:31.578586 8878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:31.579743 8878 hybrid_clock.cc:648] HybridClock initialized: now 1786177951579736 us; error 33 us; skew 500 ppm
Aug 08 08:32:31 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177951, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:31.582645 8878 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:32:31.583544 8878 webserver.cc:460] Webserver started at http://127.25.170.2:38827/ using document root <none> and password file <none>
I20260808 08:32:31.584168 8878 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:31.584270 8878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:31.588065 8878 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 08:32:31.590106 8900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:31.591351 8878 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:32:31.591496 8878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "e73792ec94344e64ad13a2e4e1974b1d"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "c23d4df48e666c89707c3d9d456ea6f2"
server_key_iv: "87a216281323e7a9ea4f3abe91a8b438"
server_key_version: "encryptionkey@0"
I20260808 08:32:31.592140 8878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:31.605672 8878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:31.608443 8878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:31.608639 8878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:31.609205 8878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:31.610323 8908 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 08:32:31.614336 8878 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 08:32:31.614410 8878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260808 08:32:31.614508 8878 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 08:32:31.616189 8878 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 08:32:31.616255 8878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260808 08:32:31.616568 8908 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Bootstrap starting.
I20260808 08:32:31.627326 8878 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:38701
I20260808 08:32:31.627377 9024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:38701 every 8 connection(s)
I20260808 08:32:31.628347 8878 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:32:31.636973 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 8878
I20260808 08:32:31.637472 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:45201
--local_ip_for_outbound_sockets=127.25.170.3
--tserver_master_addrs=127.25.170.62:40209
--webserver_port=44071
--webserver_interface=127.25.170.3
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:32:31.637636 8908 log.cc:824] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:32:31 dist-test-slave-zkpd krb5kdc[8071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177951, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:31.643783 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.630236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:45667 (local address 127.25.170.62:40209)
0808 08:32:31.630413 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:31.630419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:31.631063 (+ 644us) server_negotiation.cc:407] Connection header received
0808 08:32:31.632493 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:31.632495 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:31.632547 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:31.632620 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:31.634377 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.634895 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.636620 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.636845 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.636970 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.639957 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:31.639962 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:31.639964 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:31.639993 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:31.641670 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:31.642209 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:31.642213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:31.642214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:31.642289 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:31.642630 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:31.642634 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:31.642636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:31.642823 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:31.642936 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:31.643483 (+ 547us) server_negotiation.cc:299] Negotiation successful
0808 08:32:31.643612 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:32:31.644615 9027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.630345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:45667)
0808 08:32:31.630879 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:31.630936 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:31.632266 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:31.632835 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:31.632844 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:31.633453 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:31.634198 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.634231 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.635070 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.635077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.636499 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.636510 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.636992 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.636996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.637210 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.637917 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:31.637934 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:31.639726 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:31.641806 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:31.641812 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:31.641832 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:31.642084 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:31.642383 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:31.642386 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:31.642388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:31.642529 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:31.643020 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:31.643025 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:31.643238 (+ 213us) client_negotiation.cc:769] Sending connection context
0808 08:32:31.643437 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 08:32:31.643737 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":131,"threads_started":1}
I20260808 08:32:31.645869 9025 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40209
I20260808 08:32:31.646147 9025 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:31.646665 9025 heartbeater.cc:511] Master 127.25.170.62:40209 requested a full tablet report, sending...
I20260808 08:32:31.647352 8908 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:32:31.647884 8908 tablet_bootstrap.cc:492] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Bootstrap complete.
I20260808 08:32:31.648576 8677 ts_manager.cc:194] Registered new tserver with Master: e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701)
I20260808 08:32:31.649643 8908 ts_tablet_manager.cc:1397] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Time spent bootstrapping tablet: real 0.033s user 0.022s sys 0.009s
I20260808 08:32:31.649881 8677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:45667
I20260808 08:32:31.653106 8908 raft_consensus.cc:348] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:31.653610 8908 raft_consensus.cc:729] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e73792ec94344e64ad13a2e4e1974b1d, State: Initialized, Role: FOLLOWER
I20260808 08:32:31.654130 8908 consensus_queue.cc:260] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:31.654800 9025 heartbeater.cc:503] Master 127.25.170.62:40209 was elected leader, sending a full tablet report...
I20260808 08:32:31.655104 8908 ts_tablet_manager.cc:1428] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260808 08:32:31.658169 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.649526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:38701 (local address 127.0.0.1:57896)
0808 08:32:31.649791 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:31.649806 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:31.649881 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:31.654295 (+ 4414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:31.654298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:31.654326 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:31.654419 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.654428 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.655648 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.655651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.656819 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.656829 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.657844 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.657847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.657922 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.657960 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:32:31.658020 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 08:32:31.658079 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197}
I20260808 08:32:31.658267 9030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.649783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57896 (local address 127.25.170.2:38701)
0808 08:32:31.653873 (+ 4090us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:31.653887 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:31.653912 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:32:31.653977 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:31.653982 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:31.654138 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:31.654303 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:31.654556 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.655529 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.656933 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.657723 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.657836 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.657963 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:31.658059 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 08:32:31.658141 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3982,"thread_start_us":94,"threads_started":1}
I20260808 08:32:31.659216 8953 tablet_service.cc:1514] Processing DeleteTablet for tablet e71bfc25c23d423dae58f8c5f4574cea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:30 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:57896
I20260808 08:32:31.660013 9032 tablet_replica.cc:330] stopping tablet replica
I20260808 08:32:31.660293 9032 raft_consensus.cc:2229] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:32:31.660535 9032 raft_consensus.cc:2258] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:32:31.661415 9032 ts_tablet_manager.cc:1905] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:32:31.664934 9032 ts_tablet_manager.cc:1918] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:32:31.665051 9032 log.cc:1196] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/e71bfc25c23d423dae58f8c5f4574cea
I20260808 08:32:31.665352 9032 ts_tablet_manager.cc:1939] T e71bfc25c23d423dae58f8c5f4574cea P e73792ec94344e64ad13a2e4e1974b1d: Deleting consensus metadata
I20260808 08:32:31.666745 8662 catalog_manager.cc:4841] TS e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701): tablet e71bfc25c23d423dae58f8c5f4574cea (table test-table [id=a24c1e49f27f4e2a8a4e458d296588a5]) successfully deleted
W20260808 08:32:31.757125 9029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:31.757387 9029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:31.757465 9029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:31.761405 9029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:31.761477 9029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:31.761557 9029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:32:31.766760 9029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:45201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=44071
--tserver_master_addrs=127.25.170.62:40209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:31.767758 9029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:31.768807 9029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:31.779003 9037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:31.779003 9038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:31.779022 9040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:31.779085 9029 server_base.cc:1034] running on GCE node
I20260808 08:32:31.779604 9029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:31.780308 9029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:31.781502 9029 hybrid_clock.cc:648] HybridClock initialized: now 1786177951781486 us; error 36 us; skew 500 ppm
Aug 08 08:32:31 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177951, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:31.784225 9029 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:32:31.785135 9029 webserver.cc:460] Webserver started at http://127.25.170.3:44071/ using document root <none> and password file <none>
I20260808 08:32:31.785674 9029 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:31.785776 9029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:31.789505 9029 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 08:32:31.791450 9047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:31.792634 9029 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:32:31.792761 9029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "7ea999dcabcb4847b62d20fc746271a2"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "21f7f54a9beee5902de36a14018c0d1f"
server_key_iv: "d6bf77096a8c71599510686276dfaa09"
server_key_version: "encryptionkey@0"
I20260808 08:32:31.793290 9029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:31.815722 9029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:31.818521 9029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:31.818709 9029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:31.819276 9029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:31.820082 9029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:31.820150 9029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:31.820217 9029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:31.820262 9029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:31.829824 9029 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:45201
I20260808 08:32:31.829872 9167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:45201 every 8 connection(s)
I20260808 08:32:31.830785 9029 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:32:31.835813 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 9029
Aug 08 08:32:31 dist-test-slave-zkpd krb5kdc[8071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177951, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:31.845850 9172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.836538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54618 (local address 127.25.170.62:40209)
0808 08:32:31.836795 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:31.836799 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:31.836963 (+ 164us) server_negotiation.cc:407] Connection header received
0808 08:32:31.837095 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:31.837098 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:31.837144 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:31.837243 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:31.838090 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.838580 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.839732 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.839997 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.840072 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.841711 (+ 1639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:31.841715 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:31.841719 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:31.841754 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:31.843877 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:31.844381 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:31.844385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:31.844387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:31.844480 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:31.844795 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:31.844799 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:31.844801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:31.845006 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:31.845245 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:31.845430 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 08:32:31.845568 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":67,"threads_started":1}
I20260808 08:32:31.845988 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.832671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:41019 (local address 127.25.170.62:40209)
0808 08:32:31.832807 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:31.832815 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:31.833624 (+ 809us) server_negotiation.cc:407] Connection header received
0808 08:32:31.835230 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:31.835234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:31.835303 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:31.835438 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:31.836987 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.837644 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.839217 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.839427 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.839502 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.842419 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:31.842422 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:31.842423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:31.842475 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:31.844002 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:31.844501 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:31.844505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:31.844507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:31.844586 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:31.844931 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:31.844936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:31.844937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:31.845105 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:31.845209 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:31.845673 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 08:32:31.845788 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:32:31.846859 9170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.832963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:41019)
0808 08:32:31.833450 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:31.833496 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:31.834993 (+ 1497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:31.835629 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:31.835636 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:31.836116 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:31.836790 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.836812 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.837792 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.837796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.839095 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.839108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.839584 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.839588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.839813 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.840479 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:31.840501 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:31.842242 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:31.844116 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:31.844122 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:31.844136 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:31.844395 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:31.844680 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:31.844683 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:31.844685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:31.844831 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:31.845210 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:31.845218 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:31.845447 (+ 229us) client_negotiation.cc:769] Sending connection context
0808 08:32:31.845630 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 08:32:31.845961 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":109,"threads_started":1}
I20260808 08:32:31.848114 9168 heartbeater.cc:347] Connected to a master server at 127.25.170.62:40209
I20260808 08:32:31.848407 9168 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:31.848923 9168 heartbeater.cc:511] Master 127.25.170.62:40209 requested a full tablet report, sending...
I20260808 08:32:31.849995 8676 ts_manager.cc:194] Registered new tserver with Master: 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201)
I20260808 08:32:31.850570 8676 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:41019
I20260808 08:32:31.859541 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:32:31.863425 9172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.860194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54626 (local address 127.25.170.62:40209)
0808 08:32:31.860312 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:31.860317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:31.860494 (+ 177us) server_negotiation.cc:407] Connection header received
0808 08:32:31.860616 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:31.860618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:31.860701 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:31.860799 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:32:31.861002 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.861483 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.862263 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.862488 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.862564 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.862812 (+ 248us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:32:31.863136 (+ 324us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:32:31.863222 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:31.863286 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 08:32:31.863337 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 08:32:31.864166 8676 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:54626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:32:31.867331 8676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:32:31.874732 8953 tablet_service.cc:1467] Processing CreateTablet for tablet d1e6c2b2185148a2ab45a7172b41d525 (DEFAULT_TABLE table=test-table [id=5605b106018f489fbc250c860bef3102]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:31.874840 8805 tablet_service.cc:1467] Processing CreateTablet for tablet d1e6c2b2185148a2ab45a7172b41d525 (DEFAULT_TABLE table=test-table [id=5605b106018f489fbc250c860bef3102]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:31.875383 8805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1e6c2b2185148a2ab45a7172b41d525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:31.875383 8953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1e6c2b2185148a2ab45a7172b41d525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:31.878434 8762 tablet_bootstrap.cc:492] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Bootstrap starting.
I20260808 08:32:31.878465 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.873805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:45201 (local address 127.0.0.1:33948)
0808 08:32:31.873920 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:31.873935 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:31.874011 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:31.874943 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:31.874946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:31.874964 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:31.875054 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.875061 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.876277 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.876282 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.877241 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:31.877293 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.878103 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.878106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:31.878189 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.878211 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:32:31.878277 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 08:32:31.878351 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 08:32:31.878476 8908 tablet_bootstrap.cc:492] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d: Bootstrap starting.
I20260808 08:32:31.878527 9178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:31.874159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33948 (local address 127.25.170.3:45201)
0808 08:32:31.874554 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:31.874563 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:31.874582 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:32:31.874641 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:31.874645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:31.874801 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:31.874974 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:31.875157 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.876149 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.877425 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:31.877977 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:31.878103 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:31.878258 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:31.878311 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 08:32:31.878398 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":178,"threads_started":1}
I20260808 08:32:31.879269 8762 tablet_bootstrap.cc:654] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:31.879269 8908 tablet_bootstrap.cc:654] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:31.880436 8908 tablet_bootstrap.cc:492] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d: No bootstrap required, opened a new log
I20260808 08:32:31.880496 8908 ts_tablet_manager.cc:1397] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 08:32:31.881084 8908 raft_consensus.cc:348] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:31.881215 8908 raft_consensus.cc:374] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:31.881264 8908 raft_consensus.cc:729] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e73792ec94344e64ad13a2e4e1974b1d, State: Initialized, Role: FOLLOWER
I20260808 08:32:31.881392 8908 consensus_queue.cc:260] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:31.881649 8908 ts_tablet_manager.cc:1428] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 08:32:31.881865 8762 tablet_bootstrap.cc:492] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: No bootstrap required, opened a new log
I20260808 08:32:31.881954 8762 ts_tablet_manager.cc:1397] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260808 08:32:31.882414 8762 raft_consensus.cc:348] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:31.882534 8762 raft_consensus.cc:374] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:31.882575 8762 raft_consensus.cc:729] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f2b49f388c4c6abdd77578c4eb7b50, State: Initialized, Role: FOLLOWER
I20260808 08:32:31.882694 8762 consensus_queue.cc:260] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:31.882964 8762 ts_tablet_manager.cc:1428] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 08:32:31.883131 9099 tablet_service.cc:1467] Processing CreateTablet for tablet d1e6c2b2185148a2ab45a7172b41d525 (DEFAULT_TABLE table=test-table [id=5605b106018f489fbc250c860bef3102]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:31.884305 9099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1e6c2b2185148a2ab45a7172b41d525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:31.891666 9182 tablet_bootstrap.cc:492] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: Bootstrap starting.
I20260808 08:32:31.893642 9182 tablet_bootstrap.cc:654] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:31.894797 9182 log.cc:824] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:31.896981 9182 tablet_bootstrap.cc:492] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: No bootstrap required, opened a new log
I20260808 08:32:31.897181 9182 ts_tablet_manager.cc:1397] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:32:31.900048 9182 raft_consensus.cc:348] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:31.900288 9182 raft_consensus.cc:374] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:31.900373 9182 raft_consensus.cc:729] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ea999dcabcb4847b62d20fc746271a2, State: Initialized, Role: FOLLOWER
I20260808 08:32:31.900861 9182 consensus_queue.cc:260] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:31.901520 9168 heartbeater.cc:503] Master 127.25.170.62:40209 was elected leader, sending a full tablet report...
I20260808 08:32:31.901777 9182 ts_tablet_manager.cc:1428] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260808 08:32:31.928838 8875 tablet.cc:2369] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:32:32.026386 9184 raft_consensus.cc:482] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:32.026600 9184 raft_consensus.cc:504] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:32.027927 9184 leader_election.cc:288] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701), 36f2b49f388c4c6abdd77578c4eb7b50 (127.25.170.1:44495)
I20260808 08:32:32.032855 9030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.028304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:47589 (local address 127.25.170.2:38701)
0808 08:32:32.028434 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:32.028441 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:32.028724 (+ 283us) server_negotiation.cc:407] Connection header received
0808 08:32:32.028927 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:32.028931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:32.028988 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:32.029099 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:32.029366 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:32.030087 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:32.031529 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:32.032156 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:32.032294 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:32.032351 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:32.032634 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 08:32:32.032712 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:32:32.032857 9186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.028300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:50123 (local address 127.25.170.1:44495)
0808 08:32:32.028599 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:32.028602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:32.028615 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:32:32.028661 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:32.028664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:32.028716 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:32.028807 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:32.029117 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:32.029919 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:32.031529 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:32.032199 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:32.032318 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:32.032474 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:32.032634 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 08:32:32.032711 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":73,"threads_started":1}
I20260808 08:32:32.032858 9170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.028116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:44495 (local address 127.25.170.3:50123)
0808 08:32:32.028234 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.028252 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:32.028362 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:32.028843 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:32.028850 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:32.028869 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:32.028992 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:32.028997 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:32.030034 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:32.030036 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:32.031383 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:32.031395 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:32.032314 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:32.032318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:32.032483 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:32.032519 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:32:32.032600 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 08:32:32.032697 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":79}
I20260808 08:32:32.032866 9185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.028113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:38701 (local address 127.25.170.3:47589)
0808 08:32:32.028610 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.028622 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:32.028755 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:32.029138 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:32.029140 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:32.029156 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:32.029249 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:32.029254 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:32.030188 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:32.030191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:32.031383 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:32.031395 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:32.032314 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:32.032318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:32.032469 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:32.032527 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 08:32:32.032600 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 08:32:32.032697 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"mutex_wait_us":191,"thread_start_us":132,"threads_started":1}
I20260808 08:32:32.033537 8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e6c2b2185148a2ab45a7172b41d525" candidate_uuid: "7ea999dcabcb4847b62d20fc746271a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e73792ec94344e64ad13a2e4e1974b1d" is_pre_election: true
I20260808 08:32:32.033684 8826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e6c2b2185148a2ab45a7172b41d525" candidate_uuid: "7ea999dcabcb4847b62d20fc746271a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" is_pre_election: true
I20260808 08:32:32.033932 8974 raft_consensus.cc:2454] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ea999dcabcb4847b62d20fc746271a2 in term 0.
I20260808 08:32:32.033938 8826 raft_consensus.cc:2454] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ea999dcabcb4847b62d20fc746271a2 in term 0.
I20260808 08:32:32.034451 9050 leader_election.cc:302] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 36f2b49f388c4c6abdd77578c4eb7b50, 7ea999dcabcb4847b62d20fc746271a2, e73792ec94344e64ad13a2e4e1974b1d; no voters:
I20260808 08:32:32.034768 9184 raft_consensus.cc:2781] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:32:32.034852 9184 raft_consensus.cc:482] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:32:32.034883 9184 raft_consensus.cc:3037] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:32.036048 9184 raft_consensus.cc:504] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:32.036434 9184 leader_election.cc:288] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [CANDIDATE]: Term 1 election: Requested vote from peers e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701), 36f2b49f388c4c6abdd77578c4eb7b50 (127.25.170.1:44495)
I20260808 08:32:32.036784 8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e6c2b2185148a2ab45a7172b41d525" candidate_uuid: "7ea999dcabcb4847b62d20fc746271a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e73792ec94344e64ad13a2e4e1974b1d"
I20260808 08:32:32.036850 8826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1e6c2b2185148a2ab45a7172b41d525" candidate_uuid: "7ea999dcabcb4847b62d20fc746271a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36f2b49f388c4c6abdd77578c4eb7b50"
I20260808 08:32:32.036903 8974 raft_consensus.cc:3037] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:32.037034 8826 raft_consensus.cc:3037] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:32.038043 8974 raft_consensus.cc:2454] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ea999dcabcb4847b62d20fc746271a2 in term 1.
I20260808 08:32:32.038056 8826 raft_consensus.cc:2454] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ea999dcabcb4847b62d20fc746271a2 in term 1.
I20260808 08:32:32.038324 9050 leader_election.cc:302] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ea999dcabcb4847b62d20fc746271a2, e73792ec94344e64ad13a2e4e1974b1d; no voters:
I20260808 08:32:32.038493 9184 raft_consensus.cc:2781] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:32:32.038697 9184 raft_consensus.cc:686] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 1 LEADER]: Becoming Leader. State: Replica: 7ea999dcabcb4847b62d20fc746271a2, State: Running, Role: LEADER
I20260808 08:32:32.039052 9184 consensus_queue.cc:237] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:32.042349 8677 catalog_manager.cc:5495] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3). New cstate: current_term: 1 leader_uuid: "7ea999dcabcb4847b62d20fc746271a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } health_report { overall_health: UNKNOWN } } }
I20260808 08:32:32.072259 9178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.069027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33952 (local address 127.25.170.3:45201)
0808 08:32:32.069162 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:32.069165 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:32.069179 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:32:32.069277 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:32.069280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:32.069333 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:32.069419 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:32:32.069629 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:32.070132 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:32.070905 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:32.071108 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:32.071181 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:32.071441 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:32:32.071853 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:32:32.072021 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:32.072083 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 08:32:32.072130 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:32:32.078066 8826 raft_consensus.cc:1261] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Refusing update from remote peer 7ea999dcabcb4847b62d20fc746271a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:32:32.078066 8974 raft_consensus.cc:1261] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d [term 1 FOLLOWER]: Refusing update from remote peer 7ea999dcabcb4847b62d20fc746271a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:32:32.078747 9184 consensus_queue.cc:1035] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:32:32.078959 9187 consensus_queue.cc:1035] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:32:32.081779 9169 tablet.cc:2369] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:32:32.084182 9189 mvcc.cc:205] Tried to move back new op lower bound from 7316184891704414208 to 7316184891554844672. Current Snapshot: MvccSnapshot[applied={T|T < 7316184891704414208}]
I20260808 08:32:32.088227 9191 mvcc.cc:205] Tried to move back new op lower bound from 7316184891704414208 to 7316184891554844672. Current Snapshot: MvccSnapshot[applied={T|T < 7316184891704414208}]
I20260808 08:32:32.088447 9190 mvcc.cc:205] Tried to move back new op lower bound from 7316184891704414208 to 7316184891554844672. Current Snapshot: MvccSnapshot[applied={T|T < 7316184891704414208 or (T in {7316184891704414208})}]
I20260808 08:32:32.093519 8676 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:54626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:32:32.093689 8676 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:54626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:32:32.096271 8676 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Sending DeleteTablet for 3 replicas of tablet d1e6c2b2185148a2ab45a7172b41d525
I20260808 08:32:32.096932 8805 tablet_service.cc:1514] Processing DeleteTablet for tablet d1e6c2b2185148a2ab45a7172b41d525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:32 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:59062
I20260808 08:32:32.096961 8953 tablet_service.cc:1514] Processing DeleteTablet for tablet d1e6c2b2185148a2ab45a7172b41d525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:32 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:57896
I20260808 08:32:32.097127 9032 tablet_replica.cc:330] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d: stopping tablet replica
I20260808 08:32:32.097240 9032 raft_consensus.cc:2229] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:32:32.097380 9032 raft_consensus.cc:2258] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:32:32.098037 9032 ts_tablet_manager.cc:1905] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:32:32.098192 9099 tablet_service.cc:1514] Processing DeleteTablet for tablet d1e6c2b2185148a2ab45a7172b41d525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:32 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:33948
I20260808 08:32:32.098692 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 8717
I20260808 08:32:32.100961 9032 ts_tablet_manager.cc:1918] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:32:32.101039 9032 log.cc:1196] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/d1e6c2b2185148a2ab45a7172b41d525
I20260808 08:32:32.101311 9032 ts_tablet_manager.cc:1939] T d1e6c2b2185148a2ab45a7172b41d525 P e73792ec94344e64ad13a2e4e1974b1d: Deleting consensus metadata
I20260808 08:32:32.102701 8662 catalog_manager.cc:4841] TS e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701): tablet d1e6c2b2185148a2ab45a7172b41d525 (table test-table [id=5605b106018f489fbc250c860bef3102]) successfully deleted
I20260808 08:32:32.103394 9199 tablet_replica.cc:330] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: stopping tablet replica
I20260808 08:32:32.103722 9199 raft_consensus.cc:2229] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:32:32.104127 9199 raft_consensus.cc:2258] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:32:32.105665 9199 ts_tablet_manager.cc:1905] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:32:32.108523 9199 ts_tablet_manager.cc:1918] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:32:32.108629 9199 log.cc:1196] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/d1e6c2b2185148a2ab45a7172b41d525
I20260808 08:32:32.109011 9199 ts_tablet_manager.cc:1939] T d1e6c2b2185148a2ab45a7172b41d525 P 7ea999dcabcb4847b62d20fc746271a2: Deleting consensus metadata
W20260808 08:32:32.110316 8660 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:44495 (error 108)
I20260808 08:32:32.110359 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 8878
I20260808 08:32:32.112468 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.112074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:44495 (local address 127.0.0.1:59064)
0808 08:32:32.112273 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.112354 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:44495: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260808 08:32:32.112636 8660 catalog_manager.cc:4584] TS 36f2b49f388c4c6abdd77578c4eb7b50 (127.25.170.1:44495): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d1e6c2b2185148a2ab45a7172b41d525: Network error: Client connection negotiation failed: client connection to 127.25.170.1:44495: connect: Connection refused (error 111)
I20260808 08:32:32.114734 8662 catalog_manager.cc:4841] TS 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201): tablet d1e6c2b2185148a2ab45a7172b41d525 (table test-table [id=5605b106018f489fbc250c860bef3102]) successfully deleted
I20260808 08:32:32.121727 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 9029
I20260808 08:32:32.128816 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 8642
I20260808 08:32:32.136904 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40209
--webserver_interface=127.25.170.62
--webserver_port=33817
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:40209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:32.248692 9201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:32.249085 9201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:32.249166 9201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:32.253334 9201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:32:32.253407 9201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:32.253443 9201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:32.253477 9201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:32:32.253508 9201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:32:32.258720 9201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:40209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:40209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=33817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:32.259729 9201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:32.260769 9201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:32.269191 9212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:32.269250 9201 server_base.cc:1034] running on GCE node
W20260808 08:32:32.269201 9209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:32.269212 9208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:32.269949 9201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:32.270978 9201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:32.272161 9201 hybrid_clock.cc:648] HybridClock initialized: now 1786177952272142 us; error 31 us; skew 500 ppm
Aug 08 08:32:32 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177952, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:32.274897 9201 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:32:32.275785 9201 webserver.cc:460] Webserver started at http://127.25.170.62:33817/ using document root <none> and password file <none>
I20260808 08:32:32.276367 9201 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:32.276461 9201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:32.280228 9201 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 08:32:32.282227 9219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:32.283423 9201 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:32:32.283561 9201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "70ecffeafd8024da947105031ef55252"
server_key_iv: "af2592d6dfb3079d6158f8e2017be05b"
server_key_version: "encryptionkey@0"
I20260808 08:32:32.284133 9201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:32.294216 9201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:32.297399 9201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:32.297596 9201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:32.305362 9201 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:40209
I20260808 08:32:32.305677 9273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:40209 every 8 connection(s)
I20260808 08:32:32.306469 9201 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:32:32.310701 9274 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:32:32.312405 9274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Bootstrap starting.
I20260808 08:32:32.313292 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 9201
I20260808 08:32:32.313767 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:44495
--local_ip_for_outbound_sockets=127.25.170.1
--tserver_master_addrs=127.25.170.62:40209
--webserver_port=45319
--webserver_interface=127.25.170.1
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:32:32.330965 9274 log.cc:824] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:32.342377 9274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:32:32.342751 9274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b: Bootstrap complete.
I20260808 08:32:32.346885 9274 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:32.347312 9274 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6751c4e0c44d423f9e1b2ee2f3045d8b, State: Initialized, Role: FOLLOWER
I20260808 08:32:32.347791 9274 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:32.347970 9274 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:32:32.348073 9274 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:32:32.348243 9274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 2 FOLLOWER]: Advancing to term 3
I20260808 08:32:32.350131 9274 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:32.350474 9274 leader_election.cc:302] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6751c4e0c44d423f9e1b2ee2f3045d8b; no voters:
I20260808 08:32:32.350822 9274 leader_election.cc:288] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 08:32:32.350908 9278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 3 FOLLOWER]: Leader election won for term 3
I20260808 08:32:32.351094 9278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [term 3 LEADER]: Becoming Leader. State: Replica: 6751c4e0c44d423f9e1b2ee2f3045d8b, State: Running, Role: LEADER
I20260808 08:32:32.351387 9278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } }
I20260808 08:32:32.352160 9274 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:32:32.352757 9279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } } }
I20260808 08:32:32.352890 9279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:32.353109 9279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6751c4e0c44d423f9e1b2ee2f3045d8b. Latest consensus state: current_term: 3 leader_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6751c4e0c44d423f9e1b2ee2f3045d8b" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 40209 } } }
I20260808 08:32:32.353210 9279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6751c4e0c44d423f9e1b2ee2f3045d8b [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:32.354091 9283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:32:32.358932 9283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:32:32.359608 9283 catalog_manager.cc:1259] Loaded cluster ID: 522fd395799b413bb90a653405aeb69b
I20260808 08:32:32.359668 9283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 08:32:32.360730 9283 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f7deb0459ad google::LogMessage::Fail() at ??:0
@ 0x7f7deb04888a google::LogMessage::SendToLog() at ??:0
@ 0x7f7deb0454de google::LogMessage::Flush() at ??:0
@ 0x7f7deb046a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f7df5988fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f7df5989d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f7df5986579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f7df59ca640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f7ded2973d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f7ded297c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f7ded2993f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f7ded288512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f7dee8cc6db start_thread at ??:0
@ 0x7f7de9b4361f clone at ??:0
W20260808 08:32:32.444416 9276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:32.444650 9276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:32.444718 9276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:32.448942 9276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:32.448997 9276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:32.449082 9276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:32:32.454424 9276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:44495
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=45319
--tserver_master_addrs=127.25.170.62:40209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:32.455488 9276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:32.456570 9276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:32.466316 9317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:32.466385 9320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:32.466328 9318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:32.466642 9276 server_base.cc:1034] running on GCE node
I20260808 08:32:32.467073 9276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:32.467730 9276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:32.468907 9276 hybrid_clock.cc:648] HybridClock initialized: now 1786177952468885 us; error 60 us; skew 500 ppm
Aug 08 08:32:32 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177952, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:32.471746 9276 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:32:32.472740 9276 webserver.cc:460] Webserver started at http://127.25.170.1:45319/ using document root <none> and password file <none>
I20260808 08:32:32.473287 9276 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:32.473351 9276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:32.477222 9276 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260808 08:32:32.479383 9327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:32.480839 9276 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:32:32.480976 9276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "36f2b49f388c4c6abdd77578c4eb7b50"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "4f833923b409ffe80ba8b175b40c3b59"
server_key_iv: "da4f490e7ef9c6795aaf2702b03f77d9"
server_key_version: "encryptionkey@0"
I20260808 08:32:32.481525 9276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:32.501996 9276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:32.505359 9276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:32.505566 9276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:32.506172 9276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:32.507323 9334 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 08:32:32.512723 9276 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 08:32:32.512795 9276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 08:32:32.512888 9276 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 08:32:32.514540 9276 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 08:32:32.514611 9276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 08:32:32.514928 9334 tablet_bootstrap.cc:492] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Bootstrap starting.
I20260808 08:32:32.525537 9276 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:44495
I20260808 08:32:32.525684 9449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:44495 every 8 connection(s)
I20260808 08:32:32.526633 9276 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:32:32.532446 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 9276
I20260808 08:32:32.532891 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:38701
--local_ip_for_outbound_sockets=127.25.170.2
--tserver_master_addrs=127.25.170.62:40209
--webserver_port=38827
--webserver_interface=127.25.170.2
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:32:32.538172 9334 log.cc:824] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:32.548491 9334 tablet_bootstrap.cc:492] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:32:32.548923 9334 tablet_bootstrap.cc:492] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Bootstrap complete.
I20260808 08:32:32.550595 9334 ts_tablet_manager.cc:1397] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Time spent bootstrapping tablet: real 0.036s user 0.022s sys 0.010s
I20260808 08:32:32.553875 9334 raft_consensus.cc:348] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:32.554397 9334 raft_consensus.cc:729] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36f2b49f388c4c6abdd77578c4eb7b50, State: Initialized, Role: FOLLOWER
I20260808 08:32:32.554919 9334 consensus_queue.cc:260] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:32.556043 9334 ts_tablet_manager.cc:1428] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
W20260808 08:32:32.589007 9452 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:32:32.528653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:36257)
0808 08:32:32.529152 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.529205 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:32.530010 (+ 805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:32.588227 (+ 58217us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":161,"threads_started":1}
W20260808 08:32:32.589643 9450 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:40209 (0 consecutive failures): Network error: Failed to ping master at 127.25.170.62:40209: Client connection negotiation failed: client connection to 127.25.170.62:40209: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 08:32:32.590404 9452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.590129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:47111)
0808 08:32:32.590261 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.590348 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 08:32:32.591166 9452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.590963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:44111)
0808 08:32:32.591065 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.591110 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 08:32:32.591413 9450 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:32:32.655323 9453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:32.655568 9453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:32.655609 9453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:32.659518 9453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:32.659564 9453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:32.659618 9453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:32:32.664999 9453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:38701
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=38827
--tserver_master_addrs=127.25.170.62:40209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:32.665925 9453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:32.666855 9453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:32.676537 9463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:32.676497 9461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:32.676530 9460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:32.676831 9453 server_base.cc:1034] running on GCE node
I20260808 08:32:32.677230 9453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:32.677861 9453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:32.679023 9453 hybrid_clock.cc:648] HybridClock initialized: now 1786177952679010 us; error 25 us; skew 500 ppm
Aug 08 08:32:32 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177952, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:32.681808 9453 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:32:32.682616 9453 webserver.cc:460] Webserver started at http://127.25.170.2:38827/ using document root <none> and password file <none>
I20260808 08:32:32.683153 9453 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:32.683216 9453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:32.687369 9453 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:32:32.689438 9471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:32.690652 9453 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:32:32.690791 9453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "e73792ec94344e64ad13a2e4e1974b1d"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "c23d4df48e666c89707c3d9d456ea6f2"
server_key_iv: "87a216281323e7a9ea4f3abe91a8b438"
server_key_version: "encryptionkey@0"
I20260808 08:32:32.691339 9453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:32.704171 9453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:32.706907 9453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:32.707109 9453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:32.707695 9453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:32.708559 9453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:32.708629 9453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:32.708701 9453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:32.708745 9453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:32.717706 9453 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:38701
I20260808 08:32:32.717728 9592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:38701 every 8 connection(s)
I20260808 08:32:32.718672 9453 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:32:32.722584 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.720782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:46861)
0808 08:32:32.721238 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.721358 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":117,"threads_started":1}
W20260808 08:32:32.723043 9593 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:40209 (0 consecutive failures): Network error: Failed to ping master at 127.25.170.62:40209: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
I20260808 08:32:32.723058 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 9453
I20260808 08:32:32.723575 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:45201
--local_ip_for_outbound_sockets=127.25.170.3
--tserver_master_addrs=127.25.170.62:40209
--webserver_port=44071
--webserver_interface=127.25.170.3
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:32:32.723764 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.723493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:57161)
0808 08:32:32.723605 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.723675 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 08:32:32.724448 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.724228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:42399)
0808 08:32:32.724349 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.724402 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 08:32:32.724612 9593 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:32:32.837286 9597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:32.837550 9597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:32.837623 9597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:32.841631 9597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:32.841707 9597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:32.841794 9597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:32:32.846897 9597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:45201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=44071
--tserver_master_addrs=127.25.170.62:40209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:32.847908 9597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:32.849020 9597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:32.858479 9603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:32.858522 9605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:32.858606 9597 server_base.cc:1034] running on GCE node
W20260808 08:32:32.858489 9602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:32.859071 9597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:32.859661 9597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:32.860829 9597 hybrid_clock.cc:648] HybridClock initialized: now 1786177952860806 us; error 31 us; skew 500 ppm
Aug 08 08:32:32 dist-test-slave-zkpd krb5kdc[8071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177952, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:32.863392 9597 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:32:32.864266 9597 webserver.cc:460] Webserver started at http://127.25.170.3:44071/ using document root <none> and password file <none>
I20260808 08:32:32.864810 9597 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:32.864902 9597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:32.868518 9597 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:32:32.870466 9612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:32.871631 9597 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:32:32.871762 9597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "7ea999dcabcb4847b62d20fc746271a2"
format_stamp: "Formatted at 2026-08-08 08:32:30 on dist-test-slave-zkpd"
server_key: "21f7f54a9beee5902de36a14018c0d1f"
server_key_iv: "d6bf77096a8c71599510686276dfaa09"
server_key_version: "encryptionkey@0"
I20260808 08:32:32.872360 9597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:32.886710 9597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:32.889401 9597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:32.889621 9597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:32.890187 9597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:32.890987 9597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:32.891059 9597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:32.891129 9597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:32.891172 9597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:32.900100 9597 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:45201
I20260808 08:32:32.900167 9730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:45201 every 8 connection(s)
I20260808 08:32:32.901117 9597 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:32:32.904887 9733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.903137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:37463)
0808 08:32:32.903583 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.903696 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":121,"threads_started":1}
W20260808 08:32:32.905376 9731 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:40209 (0 consecutive failures): Network error: Failed to ping master at 127.25.170.62:40209: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
I20260808 08:32:32.905918 9733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.905715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:55767)
0808 08:32:32.905822 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.905866 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 08:32:32.906469 9733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:32.906290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:39471)
0808 08:32:32.906386 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:32.906426 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:32:32.906668 9731 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:32:32.911306 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 9597
I20260808 08:32:33.592414 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:33.592005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:55943)
0808 08:32:33.592244 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:33.592303 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":72,"threads_started":1}
I20260808 08:32:33.725492 9736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:33.725116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:52897)
0808 08:32:33.725345 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:33.725396 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":67,"threads_started":1}
I20260808 08:32:33.752487 9737 raft_consensus.cc:482] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:33.752697 9737 raft_consensus.cc:504] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:33.753913 9737 leader_election.cc:288] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201), e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701)
Aug 08 08:32:33 dist-test-slave-zkpd krb5kdc[8071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177952, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.2@KRBTEST.COM
Aug 08 08:32:33 dist-test-slave-zkpd krb5kdc[8071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177952, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.3@KRBTEST.COM
I20260808 08:32:33.768983 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:33.754115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:45201 (local address 127.25.170.1:47935)
0808 08:32:33.754283 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:33.754298 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:33.754420 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:33.756266 (+ 1846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:33.756272 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:33.756856 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:33.757350 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:33.757364 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:33.758638 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:33.758643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:33.759568 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:33.759578 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:33.760349 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:33.760352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:33.760569 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:33.761316 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:33.761331 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:33.763136 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:33.765813 (+ 2677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:33.765820 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:33.765835 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:33.766335 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:33.766729 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:33.766733 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:33.766735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:33.766968 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:33.767745 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:33.767752 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:33.768174 (+ 422us) client_negotiation.cc:769] Sending connection context
0808 08:32:33.768407 (+ 233us) client_negotiation.cc:240] Negotiation successful
0808 08:32:33.768827 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":358,"spinlock_wait_cycles":17152}
I20260808 08:32:33.769040 9740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:33.754642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:48149 (local address 127.25.170.2:38701)
0808 08:32:33.755027 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:33.755046 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:33.755078 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:32:33.755700 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:33.755705 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:33.756061 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:33.756337 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:33.757522 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:33.758481 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:33.759693 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:33.760218 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:33.760402 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:33.763327 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:33.763333 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:33.763349 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:33.763382 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:33.765675 (+ 2293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:33.766459 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:33.766465 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:33.766472 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:33.766617 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:33.767081 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:33.767084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:33.767086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:33.767610 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:33.767771 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:33.768544 (+ 773us) server_negotiation.cc:299] Negotiation successful
0808 08:32:33.768853 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":142,"threads_started":1}
I20260808 08:32:33.769032 9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:33.754373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:47935 (local address 127.25.170.3:45201)
0808 08:32:33.754695 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:33.754715 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:33.754764 (+ 49us) server_negotiation.cc:407] Connection header received
0808 08:32:33.755502 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:33.755508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:33.755856 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:33.756219 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:33.757530 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:33.758511 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:33.759698 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:33.760216 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:33.760401 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:33.763327 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:33.763333 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:33.763349 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:33.763382 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:33.765675 (+ 2293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:33.766459 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:33.766465 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:33.766472 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:33.766617 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:33.767081 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:33.767084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:33.767086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:33.767610 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:33.767740 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:33.768544 (+ 804us) server_negotiation.cc:299] Negotiation successful
0808 08:32:33.768841 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":91,"threads_started":1}
I20260808 08:32:33.768985 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:33.754438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:38701 (local address 127.25.170.1:48149)
0808 08:32:33.754779 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:33.754790 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:33.754920 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:33.756278 (+ 1358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:33.756282 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:33.756865 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:33.757351 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:33.757364 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:33.758623 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:33.758627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:33.759566 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:33.759577 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:33.760351 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:33.760355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:33.760559 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:33.761226 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:33.761242 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:33.762815 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:33.765820 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:33.765823 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:33.765835 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:33.766335 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:33.766729 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:33.766733 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:33.766735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:33.766968 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:33.767745 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:33.767752 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:33.768174 (+ 422us) client_negotiation.cc:769] Sending connection context
0808 08:32:33.768407 (+ 233us) client_negotiation.cc:240] Negotiation successful
0808 08:32:33.768773 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":257,"spinlock_wait_cycles":30208,"thread_start_us":71,"threads_started":1}
W20260808 08:32:33.772097 9330 leader_election.cc:341] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201): Not found: Tablet not found: d1e6c2b2185148a2ab45a7172b41d525
W20260808 08:32:33.772313 9330 leader_election.cc:341] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701): Not found: Tablet not found: d1e6c2b2185148a2ab45a7172b41d525
I20260808 08:32:33.772399 9330 leader_election.cc:302] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f2b49f388c4c6abdd77578c4eb7b50; no voters: 7ea999dcabcb4847b62d20fc746271a2, e73792ec94344e64ad13a2e4e1974b1d
I20260808 08:32:33.772716 9737 raft_consensus.cc:2726] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:32:33.907541 9741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:33.907147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:40555)
0808 08:32:33.907398 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:33.907449 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":80,"threads_started":1}
I20260808 08:32:34.593565 9743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:34.593165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:38337)
0808 08:32:34.593412 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:34.593469 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":76,"threads_started":1}
I20260808 08:32:34.726672 9744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:34.726270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:55257)
0808 08:32:34.726540 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:34.726589 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":111,"threads_started":1}
I20260808 08:32:34.908710 9745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:34.908263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:47055)
0808 08:32:34.908554 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:34.908608 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":122,"threads_started":1}
I20260808 08:32:35.402041 9746 raft_consensus.cc:482] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:35.402177 9746 raft_consensus.cc:504] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:35.402536 9746 leader_election.cc:288] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201), e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701)
W20260808 08:32:35.403465 9330 leader_election.cc:341] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201): Not found: Tablet not found: d1e6c2b2185148a2ab45a7172b41d525
W20260808 08:32:35.403669 9330 leader_election.cc:341] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701): Not found: Tablet not found: d1e6c2b2185148a2ab45a7172b41d525
I20260808 08:32:35.403738 9330 leader_election.cc:302] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f2b49f388c4c6abdd77578c4eb7b50; no voters: 7ea999dcabcb4847b62d20fc746271a2, e73792ec94344e64ad13a2e4e1974b1d
I20260808 08:32:35.403869 9746 raft_consensus.cc:2726] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:32:35.594852 9747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:35.594299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:57533)
0808 08:32:35.594590 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:35.594694 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":75,"threads_started":1}
I20260808 08:32:35.727768 9748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:35.727385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:51363)
0808 08:32:35.727627 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:35.727683 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
I20260808 08:32:35.909864 9749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:35.909450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:53123)
0808 08:32:35.909724 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:35.909780 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":68,"threads_started":1}
I20260808 08:32:36.596100 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:36.595576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:43985)
0808 08:32:36.595853 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:36.595962 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":90,"threads_started":1}
I20260808 08:32:36.728852 9751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:36.728481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:58907)
0808 08:32:36.728718 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:36.728769 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":85,"threads_started":1}
I20260808 08:32:36.910938 9752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:36.910555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:51751)
0808 08:32:36.910798 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:36.910852 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":71,"threads_started":1}
I20260808 08:32:37.597422 9753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:37.596976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:38581)
0808 08:32:37.597256 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:37.597316 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":69,"threads_started":1}
I20260808 08:32:37.730050 9754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:37.729621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:60151)
0808 08:32:37.729907 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:37.729960 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":102,"threads_started":1}
I20260808 08:32:37.912144 9755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:37.911692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:34205)
0808 08:32:37.912000 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:37.912065 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":94,"threads_started":1}
I20260808 08:32:37.915931 9756 raft_consensus.cc:482] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:37.916070 9756 raft_consensus.cc:504] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:37.916504 9756 leader_election.cc:288] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201), e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701)
W20260808 08:32:37.917232 9330 leader_election.cc:341] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201): Not found: Tablet not found: d1e6c2b2185148a2ab45a7172b41d525
W20260808 08:32:37.917451 9330 leader_election.cc:341] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701): Not found: Tablet not found: d1e6c2b2185148a2ab45a7172b41d525
I20260808 08:32:37.917532 9330 leader_election.cc:302] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f2b49f388c4c6abdd77578c4eb7b50; no voters: 7ea999dcabcb4847b62d20fc746271a2, e73792ec94344e64ad13a2e4e1974b1d
I20260808 08:32:37.917729 9756 raft_consensus.cc:2726] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:32:38.598531 9757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:38.598112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:37253)
0808 08:32:38.598381 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:38.598434 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":74,"threads_started":1}
I20260808 08:32:38.731258 9758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:38.730739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:37275)
0808 08:32:38.731019 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:38.731125 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":78,"threads_started":1}
I20260808 08:32:38.913367 9759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:38.912895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:37275)
0808 08:32:38.913178 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:38.913254 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":90,"threads_started":1}
I20260808 08:32:39.599684 9760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:39.599294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:51239)
0808 08:32:39.599541 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:39.599590 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":76,"threads_started":1}
I20260808 08:32:39.732491 9761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:39.732045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:58561)
0808 08:32:39.732344 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:39.732399 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":67,"threads_started":1}
I20260808 08:32:39.914481 9762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:39.914027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:44035)
0808 08:32:39.914345 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:39.914400 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":68,"threads_started":1}
I20260808 08:32:40.600847 9763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:40.600433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:60653)
0808 08:32:40.600688 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:40.600749 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":77,"threads_started":1}
I20260808 08:32:40.733676 9764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:40.733270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:59599)
0808 08:32:40.733526 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:40.733584 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":77,"threads_started":1}
I20260808 08:32:40.915686 9765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:40.915262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:41587)
0808 08:32:40.915536 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:40.915598 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":105,"threads_started":1}
I20260808 08:32:41.516261 9766 raft_consensus.cc:482] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:41.516402 9766 raft_consensus.cc:504] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:41.516844 9766 leader_election.cc:288] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201), e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701)
W20260808 08:32:41.517635 9330 leader_election.cc:341] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201): Not found: Tablet not found: d1e6c2b2185148a2ab45a7172b41d525
W20260808 08:32:41.517823 9330 leader_election.cc:341] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701): Not found: Tablet not found: d1e6c2b2185148a2ab45a7172b41d525
I20260808 08:32:41.517887 9330 leader_election.cc:302] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f2b49f388c4c6abdd77578c4eb7b50; no voters: 7ea999dcabcb4847b62d20fc746271a2, e73792ec94344e64ad13a2e4e1974b1d
I20260808 08:32:41.518055 9766 raft_consensus.cc:2726] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:32:41.602002 9767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:41.601598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:60787)
0808 08:32:41.601849 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:41.601904 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":76,"threads_started":1}
I20260808 08:32:41.734917 9768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:41.734442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:54087)
0808 08:32:41.734745 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:41.734825 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":81,"threads_started":1}
I20260808 08:32:41.916802 9769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:41.916425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:60821)
0808 08:32:41.916661 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:41.916714 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":74,"threads_started":1}
I20260808 08:32:42.603235 9771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:42.602837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:52099)
0808 08:32:42.603086 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:42.603139 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":81,"threads_started":1}
I20260808 08:32:42.736151 9772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:42.735718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:38181)
0808 08:32:42.736004 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:42.736057 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":100,"threads_started":1}
I20260808 08:32:42.917975 9774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:42.917548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:45721)
0808 08:32:42.917821 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:42.917881 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":76,"threads_started":1}
I20260808 08:32:43.604555 9775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:43.604018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:49183)
0808 08:32:43.604361 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:43.604435 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":86,"threads_started":1}
I20260808 08:32:43.737347 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:43.736952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:60707)
0808 08:32:43.737195 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:43.737250 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":73,"threads_started":1}
I20260808 08:32:43.919106 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:43.918687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:39437)
0808 08:32:43.918957 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:43.919014 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":75,"threads_started":1}
I20260808 08:32:44.605625 9778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:44.605226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:43357)
0808 08:32:44.605474 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:44.605526 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":82,"threads_started":1}
I20260808 08:32:44.738526 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:44.738066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:51071)
0808 08:32:44.738359 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:44.738419 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":79,"threads_started":1}
I20260808 08:32:44.920328 9780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:44.919860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:44579)
0808 08:32:44.920182 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:44.920240 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":139,"threads_started":1}
I20260808 08:32:45.606761 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:45.606355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:44603)
0808 08:32:45.606611 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:45.606667 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":76,"threads_started":1}
I20260808 08:32:45.739686 9782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:45.739276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:54479)
0808 08:32:45.739540 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:45.739593 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":77,"threads_started":1}
I20260808 08:32:45.921542 9784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:45.921118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:55789)
0808 08:32:45.921396 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:45.921448 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":90,"threads_started":1}
I20260808 08:32:46.608121 9785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:46.607620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:55813)
0808 08:32:46.607963 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:46.608021 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":93,"threads_started":1}
I20260808 08:32:46.740877 9786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:46.740464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:39609)
0808 08:32:46.740726 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:46.740787 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":99,"threads_started":1}
I20260808 08:32:46.922725 9788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:46.922313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:49659)
0808 08:32:46.922571 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:46.922629 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":76,"threads_started":1}
I20260808 08:32:47.001713 9789 raft_consensus.cc:482] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:47.001983 9789 raft_consensus.cc:504] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ea999dcabcb4847b62d20fc746271a2" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 45201 } } peers { permanent_uuid: "e73792ec94344e64ad13a2e4e1974b1d" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 38701 } } peers { permanent_uuid: "36f2b49f388c4c6abdd77578c4eb7b50" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 44495 } }
I20260808 08:32:47.002447 9789 leader_election.cc:288] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201), e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701)
W20260808 08:32:47.003289 9330 leader_election.cc:341] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7ea999dcabcb4847b62d20fc746271a2 (127.25.170.3:45201): Not found: Tablet not found: d1e6c2b2185148a2ab45a7172b41d525
W20260808 08:32:47.003434 9330 leader_election.cc:341] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e73792ec94344e64ad13a2e4e1974b1d (127.25.170.2:38701): Not found: Tablet not found: d1e6c2b2185148a2ab45a7172b41d525
I20260808 08:32:47.003496 9330 leader_election.cc:302] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36f2b49f388c4c6abdd77578c4eb7b50; no voters: 7ea999dcabcb4847b62d20fc746271a2, e73792ec94344e64ad13a2e4e1974b1d
I20260808 08:32:47.003646 9789 raft_consensus.cc:2726] T d1e6c2b2185148a2ab45a7172b41d525 P 36f2b49f388c4c6abdd77578c4eb7b50 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:32:47.609472 9790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:47.608988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.1:50407)
0808 08:32:47.609287 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:47.609354 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":91,"threads_started":1}
I20260808 08:32:47.742156 9791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:47.741748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.2:45233)
0808 08:32:47.742013 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:47.742067 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":93,"threads_started":1}
I20260808 08:32:47.916587 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 9276
I20260808 08:32:47.924026 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:47.923568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:40209 (local address 127.25.170.3:37661)
0808 08:32:47.923820 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:47.923875 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:40209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":95,"threads_started":1}
I20260808 08:32:47.925079 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 9453
I20260808 08:32:47.931810 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 9597
2026-08-08T08:32:47Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19248 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:32:47 dist-test-slave-zkpd krb5kdc[9795](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:32:47 dist-test-slave-zkpd krb5kdc[9795](info): set up 2 sockets
Aug 08 08:32:47 dist-test-slave-zkpd krb5kdc[9795](info): commencing operation
krb5kdc: starting...
W20260808 08:32:49.018149 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:32:49 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177969, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:32:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:32:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:32:49.143110 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39679
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:39679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:49.255496 9809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:49.255796 9809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:49.255875 9809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:49.259963 9809 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:32:49.260015 9809 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:32:49.260039 9809 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:32:49.260054 9809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:32:49.260071 9809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:49.260089 9809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:49.260105 9809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:32:49.260120 9809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:32:49.265328 9809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:39679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:49.266265 9809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:49.267191 9809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:32:49.275840 9809 server_base.cc:1034] running on GCE node
W20260808 08:32:49.275794 9815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:49.275787 9814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:49.275781 9817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:49.276638 9809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:49.277760 9809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:49.278934 9809 hybrid_clock.cc:648] HybridClock initialized: now 1786177969278914 us; error 30 us; skew 500 ppm
Aug 08 08:32:49 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177969, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:49.281706 9809 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:32:49.282608 9809 webserver.cc:460] Webserver started at http://127.25.170.62:41925/ using document root <none> and password file <none>
I20260808 08:32:49.283147 9809 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:49.283207 9809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:49.283447 9809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:49.285524 9809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "1d2d5e3d02ab4848a111ab17e52dc51c"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "11151367f18c161033dff820b837a7c3"
server_key_iv: "ec6b296f080594e19e219e014140d08b"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.286093 9809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "1d2d5e3d02ab4848a111ab17e52dc51c"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "11151367f18c161033dff820b837a7c3"
server_key_iv: "ec6b296f080594e19e219e014140d08b"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.289784 9809 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 08:32:49.292111 9824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:49.293326 9809 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:32:49.293427 9809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "1d2d5e3d02ab4848a111ab17e52dc51c"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "11151367f18c161033dff820b837a7c3"
server_key_iv: "ec6b296f080594e19e219e014140d08b"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.293558 9809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:49.309091 9809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:49.311818 9809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:49.312044 9809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:49.319185 9809 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:39679
I20260808 08:32:49.319511 9882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:39679 every 8 connection(s)
I20260808 08:32:49.320218 9809 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:32:49.322954 9883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:49.328435 9883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Bootstrap starting.
I20260808 08:32:49.329713 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 9809
I20260808 08:32:49.329850 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:32:49.330134 26280 external_mini_cluster.cc:1428] Setting key 3b3f394ddba63c3a19f5d20a921d8de9
I20260808 08:32:49.331099 9883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:49.331822 9883 log.cc:824] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:49.333962 9883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: No bootstrap required, opened a new log
I20260808 08:32:49.338285 9883 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:32:49.338598 9883 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:49.338701 9883 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d2d5e3d02ab4848a111ab17e52dc51c, State: Initialized, Role: FOLLOWER
Aug 08 08:32:49 dist-test-slave-zkpd krb5kdc[9795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177969, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:49.339147 9883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:32:49.339330 9883 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:32:49.339398 9883 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:32:49.339496 9883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:49.340395 9883 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:32:49.340728 9883 leader_election.cc:302] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d2d5e3d02ab4848a111ab17e52dc51c; no voters:
I20260808 08:32:49.341080 9883 leader_election.cc:288] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:32:49.341197 9889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:32:49.341424 9889 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 1 LEADER]: Becoming Leader. State: Replica: 1d2d5e3d02ab4848a111ab17e52dc51c, State: Running, Role: LEADER
I20260808 08:32:49.341756 9889 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:32:49.342371 9883 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:32:49.343369 9891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } } }
I20260808 08:32:49.343494 9891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:49.343815 9892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d2d5e3d02ab4848a111ab17e52dc51c. Latest consensus state: current_term: 1 leader_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } } }
I20260808 08:32:49.344050 9892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: This master's current role is: LEADER
I20260808 08:32:49.344700 9900 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:32:49.345870 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:49.331252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45252 (local address 127.25.170.62:39679)
0808 08:32:49.331710 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:49.331726 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:49.331760 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:32:49.332433 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:49.332450 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:49.332749 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:49.333014 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:49.333947 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:49.334953 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:49.336215 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:49.336699 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:49.336823 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:49.339798 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:49.339803 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:49.339817 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:49.339843 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:49.341999 (+ 2156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:49.342546 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:49.342552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:49.342558 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:49.342702 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:49.343074 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:49.343080 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:49.343084 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:49.343648 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:49.344641 (+ 993us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:49.344821 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 08:32:49.345148 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":159,"threads_started":1}
I20260808 08:32:49.348647 9900 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:32:49.353860 9900 catalog_manager.cc:1347] Generated new cluster ID: be92c5cecbc140f4abf23103c916fc24
I20260808 08:32:49.353922 9900 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:32:49.373097 9900 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:32:49.374125 9900 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:32:49.378163 9900 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Generated new TSK 0
I20260808 08:32:49.378829 9900 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:32:49.410768 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39679
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:49.529264 9912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:49.529491 9912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:49.529531 9912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:49.533411 9912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:49.533458 9912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:49.533511 9912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:32:49.538450 9912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:49.539404 9912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:49.540405 9912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:49.550215 9918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:49.550305 9912 server_base.cc:1034] running on GCE node
W20260808 08:32:49.550238 9921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:49.550235 9919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:49.550819 9912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:49.551368 9912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:49.552523 9912 hybrid_clock.cc:648] HybridClock initialized: now 1786177969552509 us; error 24 us; skew 500 ppm
Aug 08 08:32:49 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177969, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:49.555433 9912 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:32:49.556335 9912 webserver.cc:460] Webserver started at http://127.25.170.1:43949/ using document root <none> and password file <none>
I20260808 08:32:49.556938 9912 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:49.556999 9912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:49.557235 9912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:49.559234 9912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "9307344866e44460974efd72b18e534a"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "78926e66c20b9f1c354a008982c4b1d6"
server_key_iv: "c0716c4cede5b8fc9ce0e20e5e36362a"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.559784 9912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "9307344866e44460974efd72b18e534a"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "78926e66c20b9f1c354a008982c4b1d6"
server_key_iv: "c0716c4cede5b8fc9ce0e20e5e36362a"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.563347 9912 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:32:49.565826 9928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:49.567106 9912 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:32:49.567236 9912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "9307344866e44460974efd72b18e534a"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "78926e66c20b9f1c354a008982c4b1d6"
server_key_iv: "c0716c4cede5b8fc9ce0e20e5e36362a"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.567348 9912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:49.585101 9912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:49.588421 9912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:49.588619 9912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:49.589205 9912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:49.590016 9912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:49.590086 9912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:49.590158 9912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:49.590210 9912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:49.599848 9912 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:45191
I20260808 08:32:49.599867 10047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:45191 every 8 connection(s)
I20260808 08:32:49.600757 9912 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:32:49.607458 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 9912
I20260808 08:32:49.607605 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:32:49.607930 26280 external_mini_cluster.cc:1428] Setting key 52b8444ce821b5361f602aa3a8ee9bfc
Aug 08 08:32:49 dist-test-slave-zkpd krb5kdc[9795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177969, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:49.614456 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:49.602517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:44275 (local address 127.25.170.62:39679)
0808 08:32:49.602648 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:49.602652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:49.603431 (+ 779us) server_negotiation.cc:407] Connection header received
0808 08:32:49.604762 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:49.604765 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:49.604835 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:49.604958 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:49.606089 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:49.606626 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:49.607820 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:49.608166 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:49.608282 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:49.610706 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:49.610710 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:49.610712 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:49.610738 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:49.612242 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:49.612751 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:49.612755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:49.612758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:49.612842 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:49.613176 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:49.613180 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:49.613182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:49.613363 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:49.613468 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:49.614060 (+ 592us) server_negotiation.cc:299] Negotiation successful
0808 08:32:49.614211 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 08:32:49.615144 10050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:49.602841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:44275)
0808 08:32:49.603288 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:49.603333 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:49.604556 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:49.605126 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:49.605132 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:49.605480 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:49.605947 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:49.605959 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:49.606761 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:49.606765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:49.607692 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:49.607705 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:49.608329 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:49.608333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:49.608502 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:49.609073 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:49.609092 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:49.610547 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:49.612363 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:49.612369 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:49.612383 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:49.612640 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:49.612937 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:49.612941 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:49.612943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:49.613081 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:49.613469 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:49.613476 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:49.613727 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 08:32:49.613961 (+ 234us) client_negotiation.cc:240] Negotiation successful
0808 08:32:49.614262 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":116,"threads_started":1}
I20260808 08:32:49.616446 10048 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39679
I20260808 08:32:49.616672 10048 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:49.617159 10048 heartbeater.cc:511] Master 127.25.170.62:39679 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
I20260808 08:32:49.618710 9844 ts_manager.cc:194] Registered new tserver with Master: 9307344866e44460974efd72b18e534a (127.25.170.1:45191)
I20260808 08:32:49.619966 9844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:44275
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:32:49.635207 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39679
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:49.745891 10053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:49.746155 10053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:49.746196 10053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:49.750113 10053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:49.750165 10053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:49.750260 10053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:32:49.755527 10053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:49.756525 10053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:49.757513 10053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:32:49.767026 10053 server_base.cc:1034] running on GCE node
W20260808 08:32:49.766974 10058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:49.766953 10059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:49.766984 10061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:49.767715 10053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:49.768332 10053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:49.769485 10053 hybrid_clock.cc:648] HybridClock initialized: now 1786177969769468 us; error 29 us; skew 500 ppm
Aug 08 08:32:49 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177969, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:49.772334 10053 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:32:49.773183 10053 webserver.cc:460] Webserver started at http://127.25.170.2:41585/ using document root <none> and password file <none>
I20260808 08:32:49.773725 10053 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:49.773785 10053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:49.774035 10053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:49.776069 10053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "fbd2878e91a147af956b939ef3b5404e"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "0e56e32b6e3e2f3e73d25680d8622bea"
server_key_iv: "ea09c47608766cbb810305f8df6a5e4b"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.776623 10053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "fbd2878e91a147af956b939ef3b5404e"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "0e56e32b6e3e2f3e73d25680d8622bea"
server_key_iv: "ea09c47608766cbb810305f8df6a5e4b"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.780252 10053 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:32:49.782712 10069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:49.783880 10053 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:32:49.784082 10053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "fbd2878e91a147af956b939ef3b5404e"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "0e56e32b6e3e2f3e73d25680d8622bea"
server_key_iv: "ea09c47608766cbb810305f8df6a5e4b"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.784196 10053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:49.798354 10053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:49.801142 10053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:49.801326 10053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:49.801899 10053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:49.802693 10053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:49.802764 10053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:49.802843 10053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:49.802896 10053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:49.812170 10053 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:37931
I20260808 08:32:49.812199 10191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:37931 every 8 connection(s)
I20260808 08:32:49.813019 10053 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:32:49.821365 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 10053
I20260808 08:32:49.821492 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:32:49.821835 26280 external_mini_cluster.cc:1428] Setting key 247cc9014414051459f87caaf24801c0
Aug 08 08:32:49 dist-test-slave-zkpd krb5kdc[9795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177969, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:49.826992 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:49.814800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:43539 (local address 127.25.170.62:39679)
0808 08:32:49.814947 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:49.814952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:49.815879 (+ 927us) server_negotiation.cc:407] Connection header received
0808 08:32:49.817194 (+ 1315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:49.817197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:49.817244 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:49.817322 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:49.818440 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:49.818998 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:49.820123 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:49.820342 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:49.820424 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:49.823078 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:49.823081 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:49.823083 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:49.823107 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:49.824786 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:49.825295 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:49.825301 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:49.825305 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:49.825401 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:49.825829 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:49.825833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:49.825836 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:49.826020 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:49.826098 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:49.826778 (+ 680us) server_negotiation.cc:299] Negotiation successful
0808 08:32:49.826880 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:32:49.828220 10194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:49.815270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:43539)
0808 08:32:49.815719 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:49.815761 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:49.816982 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:49.817489 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:49.817495 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:49.817841 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:49.818301 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:49.818317 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:49.819109 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:49.819111 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:49.820007 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:49.820016 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:49.820473 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:49.820476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:49.820611 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:49.821182 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:49.821202 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:49.822900 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:49.824919 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:49.824924 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:49.824935 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:49.825195 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:49.825499 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:49.825501 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:49.825502 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:49.825704 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:49.826127 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:49.826136 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:49.826524 (+ 388us) client_negotiation.cc:769] Sending connection context
0808 08:32:49.826743 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 08:32:49.827110 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":111,"threads_started":1}
I20260808 08:32:49.829414 10192 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39679
I20260808 08:32:49.829655 10192 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:49.830133 10192 heartbeater.cc:511] Master 127.25.170.62:39679 requested a full tablet report, sending...
I20260808 08:32:49.831162 9844 ts_manager.cc:194] Registered new tserver with Master: fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931)
I20260808 08:32:49.831707 9844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:43539
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:32:49.851861 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39679
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:32:49.964198 10197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:32:49.964425 10197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:32:49.964497 10197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:32:49.968420 10197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:32:49.968472 10197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:32:49.968575 10197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:32:49.973909 10197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:32:49.974905 10197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:32:49.975876 10197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:32:49.985371 10203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:49.985426 10197 server_base.cc:1034] running on GCE node
W20260808 08:32:49.985344 10204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:32:49.985355 10207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:32:49.986039 10197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:32:49.986585 10197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:32:49.987751 10197 hybrid_clock.cc:648] HybridClock initialized: now 1786177969987738 us; error 25 us; skew 500 ppm
Aug 08 08:32:49 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177969, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:32:49.990592 10197 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:32:49.991500 10197 webserver.cc:460] Webserver started at http://127.25.170.3:40305/ using document root <none> and password file <none>
I20260808 08:32:49.992125 10197 fs_manager.cc:359] Metadata directory not provided
I20260808 08:32:49.992211 10197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:32:49.992441 10197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:32:49.994493 10197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "cd987bc85f934d5487b9b290795760cb"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "e51d2ebdec8a8841ae070d2ca71c8c16"
server_key_iv: "510e36972d20499dd203ae289fa0a5a8"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.995067 10197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "cd987bc85f934d5487b9b290795760cb"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "e51d2ebdec8a8841ae070d2ca71c8c16"
server_key_iv: "510e36972d20499dd203ae289fa0a5a8"
server_key_version: "encryptionkey@0"
I20260808 08:32:49.998894 10197 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 08:32:50.001237 10215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:50.002435 10197 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:32:50.002575 10197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "cd987bc85f934d5487b9b290795760cb"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "e51d2ebdec8a8841ae070d2ca71c8c16"
server_key_iv: "510e36972d20499dd203ae289fa0a5a8"
server_key_version: "encryptionkey@0"
I20260808 08:32:50.002683 10197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:32:50.023010 10197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:32:50.026436 10197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:32:50.026646 10197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:32:50.027254 10197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:32:50.028154 10197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:32:50.028220 10197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:50.028291 10197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:32:50.028337 10197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:32:50.037539 10197 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:35657
I20260808 08:32:50.037572 10340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:35657 every 8 connection(s)
I20260808 08:32:50.038401 10197 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
Aug 08 08:32:50 dist-test-slave-zkpd krb5kdc[9795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177969, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:32:50.048275 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 10197
I20260808 08:32:50.048429 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:32:50.048758 26280 external_mini_cluster.cc:1428] Setting key cf370497c6a0a26b842d27068d36a63c
I20260808 08:32:50.052398 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.040255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:37227 (local address 127.25.170.62:39679)
0808 08:32:50.040404 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:50.040408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:50.041223 (+ 815us) server_negotiation.cc:407] Connection header received
0808 08:32:50.042593 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:50.042596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:50.042656 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:50.042765 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:50.044077 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.044674 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.045820 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.046045 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.046160 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.048785 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:50.048789 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:50.048791 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:50.048838 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:50.050451 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:50.051027 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:50.051029 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:50.051030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:50.051106 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:50.051413 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:50.051415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:50.051416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:50.051580 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:50.051654 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:50.052182 (+ 528us) server_negotiation.cc:299] Negotiation successful
0808 08:32:50.052286 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:32:50.053171 10343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.040629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:37227)
0808 08:32:50.041074 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:50.041117 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:50.042387 (+ 1270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:50.042940 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:50.042947 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:50.043363 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:32:50.043930 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.043946 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.044797 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.044801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.045679 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.045690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.046202 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.046206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.046385 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.046913 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:32:50.046929 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:32:50.048610 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:32:50.050567 (+ 1957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:50.050572 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:50.050586 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:50.050938 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:50.051189 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:32:50.051191 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:32:50.051193 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:32:50.051336 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:32:50.051668 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:32:50.051672 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:32:50.051939 (+ 267us) client_negotiation.cc:769] Sending connection context
0808 08:32:50.052132 (+ 193us) client_negotiation.cc:240] Negotiation successful
0808 08:32:50.052380 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":124,"threads_started":1}
I20260808 08:32:50.054224 10341 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39679
I20260808 08:32:50.054471 10341 heartbeater.cc:464] Registering TS with master...
I20260808 08:32:50.054942 10341 heartbeater.cc:511] Master 127.25.170.62:39679 requested a full tablet report, sending...
I20260808 08:32:50.055997 9844 ts_manager.cc:194] Registered new tserver with Master: cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657)
I20260808 08:32:50.056550 9844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:37227
I20260808 08:32:50.062264 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:32:50.071276 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.064306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45268 (local address 127.25.170.62:39679)
0808 08:32:50.064479 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:50.064484 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:50.064688 (+ 204us) server_negotiation.cc:407] Connection header received
0808 08:32:50.064769 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:50.064771 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:50.064840 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:50.064904 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:32:50.065550 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.066036 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.066890 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.067090 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.067160 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.068549 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:32:50.068552 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:32:50.068553 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:32:50.068571 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:32:50.069743 (+ 1172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:50.070126 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:50.070129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:50.070130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:50.070201 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:32:50.070434 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:32:50.070436 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:32:50.070437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:32:50.070626 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:32:50.070724 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:50.070976 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 08:32:50.071093 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 08:32:50.074117 9844 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:32:50.077153 9844 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:32:50.091127 10354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.085348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:37931 (local address 127.0.0.1:54118)
0808 08:32:50.086128 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:50.086181 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:50.086307 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:50.086884 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:50.086894 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:50.086922 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:50.087124 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.087139 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.088469 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.088473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.089704 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.089714 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.090555 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.090558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.090694 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.090735 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 08:32:50.090855 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 08:32:50.090978 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"mutex_wait_us":1,"thread_start_us":89,"threads_started":1}
I20260808 08:32:50.091137 10356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.085494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54118 (local address 127.25.170.2:37931)
0808 08:32:50.086355 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:50.086369 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:50.086397 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:32:50.086488 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:50.086494 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:50.086723 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:50.086893 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:50.087246 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.088332 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.089854 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.090425 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.090554 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.090745 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:50.090882 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 08:32:50.090978 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":185,"threads_started":1}
I20260808 08:32:50.092484 10359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.086060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45191 (local address 127.0.0.1:37790)
0808 08:32:50.086855 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:50.086868 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:50.087024 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:50.087753 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:50.087756 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:50.087786 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:50.087866 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.087871 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.089298 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.089302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.090643 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.090665 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.091988 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.091992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.092126 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.092184 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 08:32:50.092258 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 08:32:50.092348 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"mutex_wait_us":56,"spinlock_wait_cycles":11008,"thread_start_us":88,"threads_started":1}
I20260808 08:32:50.092617 10358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.085827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54086 (local address 127.25.170.3:35657)
0808 08:32:50.087116 (+ 1289us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:50.087126 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:50.087144 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:32:50.087236 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:50.087241 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:50.087421 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:50.087578 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:50.087834 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.089127 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.090803 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.091648 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.091756 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.091919 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:50.092360 (+ 441us) server_negotiation.cc:299] Negotiation successful
0808 08:32:50.092460 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1180,"thread_start_us":168,"threads_started":1}
I20260808 08:32:50.092839 10357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.085623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:35657 (local address 127.0.0.1:54086)
0808 08:32:50.086679 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:50.086693 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:50.086795 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:50.087574 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:50.087579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:50.087598 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:50.087691 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.087697 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.089298 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.089302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.090643 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.090671 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.091988 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.091992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.092168 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.092184 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 08:32:50.092258 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 08:32:50.092717 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":997,"mutex_wait_us":591,"thread_start_us":95,"threads_started":1}
I20260808 08:32:50.093261 10360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.086481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37790 (local address 127.25.170.1:45191)
0808 08:32:50.086755 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:50.086772 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:50.087238 (+ 466us) server_negotiation.cc:407] Connection header received
0808 08:32:50.087310 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:50.087315 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:50.087463 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:50.087627 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:50.087995 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.089165 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.090803 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.091648 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.091756 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.091919 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:50.092980 (+ 1061us) server_negotiation.cc:299] Negotiation successful
0808 08:32:50.093110 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":113,"threads_started":1}
I20260808 08:32:50.094856 10119 tablet_service.cc:1467] Processing CreateTablet for tablet d456545458fd4c429a23fcbc444f2d0a (DEFAULT_TABLE table=test-table [id=490b9a14ec8c4fb99be13ed52475bf7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:50.095913 10119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d456545458fd4c429a23fcbc444f2d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:50.095736 9979 tablet_service.cc:1467] Processing CreateTablet for tablet d456545458fd4c429a23fcbc444f2d0a (DEFAULT_TABLE table=test-table [id=490b9a14ec8c4fb99be13ed52475bf7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:50.095736 10267 tablet_service.cc:1467] Processing CreateTablet for tablet d456545458fd4c429a23fcbc444f2d0a (DEFAULT_TABLE table=test-table [id=490b9a14ec8c4fb99be13ed52475bf7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:32:50.096830 9979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d456545458fd4c429a23fcbc444f2d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:50.096848 10267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d456545458fd4c429a23fcbc444f2d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:32:50.102912 10361 tablet_bootstrap.cc:492] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: Bootstrap starting.
I20260808 08:32:50.104449 10363 tablet_bootstrap.cc:492] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Bootstrap starting.
I20260808 08:32:50.104802 10362 tablet_bootstrap.cc:492] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: Bootstrap starting.
I20260808 08:32:50.105665 10361 tablet_bootstrap.cc:654] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:50.106528 10361 log.cc:824] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:50.107149 10362 tablet_bootstrap.cc:654] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:50.108074 10362 log.cc:824] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:50.108795 10361 tablet_bootstrap.cc:492] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: No bootstrap required, opened a new log
I20260808 08:32:50.109035 10361 ts_tablet_manager.cc:1397] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:32:50.109182 10363 tablet_bootstrap.cc:654] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Neither blocks nor log segments found. Creating new log.
I20260808 08:32:50.110113 10362 tablet_bootstrap.cc:492] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: No bootstrap required, opened a new log
I20260808 08:32:50.110134 10363 log.cc:824] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:32:50.110298 10362 ts_tablet_manager.cc:1397] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:32:50.111773 10363 tablet_bootstrap.cc:492] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: No bootstrap required, opened a new log
I20260808 08:32:50.111994 10363 ts_tablet_manager.cc:1397] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.003s
I20260808 08:32:50.112993 10361 raft_consensus.cc:348] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:32:50.113301 10361 raft_consensus.cc:374] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:50.113372 10361 raft_consensus.cc:729] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbd2878e91a147af956b939ef3b5404e, State: Initialized, Role: FOLLOWER
I20260808 08:32:50.113910 10361 consensus_queue.cc:260] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:32:50.114145 10362 raft_consensus.cc:348] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:32:50.114476 10362 raft_consensus.cc:374] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:50.114573 10362 raft_consensus.cc:729] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd987bc85f934d5487b9b290795760cb, State: Initialized, Role: FOLLOWER
I20260808 08:32:50.114657 10192 heartbeater.cc:503] Master 127.25.170.62:39679 was elected leader, sending a full tablet report...
I20260808 08:32:50.114997 10361 ts_tablet_manager.cc:1428] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:32:50.115121 10362 consensus_queue.cc:260] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:32:50.115795 10341 heartbeater.cc:503] Master 127.25.170.62:39679 was elected leader, sending a full tablet report...
I20260808 08:32:50.116093 10363 raft_consensus.cc:348] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:32:50.116328 10363 raft_consensus.cc:374] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:32:50.116374 10363 raft_consensus.cc:729] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9307344866e44460974efd72b18e534a, State: Initialized, Role: FOLLOWER
I20260808 08:32:50.116993 10362 ts_tablet_manager.cc:1428] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 08:32:50.116770 10363 consensus_queue.cc:260] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:32:50.117727 10048 heartbeater.cc:503] Master 127.25.170.62:39679 was elected leader, sending a full tablet report...
I20260808 08:32:50.119210 10363 ts_tablet_manager.cc:1428] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:32:50.172413 10368 raft_consensus.cc:482] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:32:50.173062 10368 raft_consensus.cc:504] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:32:50.174845 10368 leader_election.cc:288] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931), 9307344866e44460974efd72b18e534a (127.25.170.1:45191)
I20260808 08:32:50.180267 10360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.175658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:40035 (local address 127.25.170.1:45191)
0808 08:32:50.176104 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:50.176111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:50.176131 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:32:50.176198 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:50.176203 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:50.176265 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:50.176374 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:50.176646 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.177431 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.179193 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.179595 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.179725 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.179785 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:50.180027 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 08:32:50.180115 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327}
I20260808 08:32:50.180384 10343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.175126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:37931 (local address 127.25.170.3:34095)
0808 08:32:50.175263 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:50.175280 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:50.175380 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:50.176185 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:50.176187 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:50.176201 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:50.176304 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.176308 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.177498 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.177502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.178958 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.178972 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.179979 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.179985 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.180101 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.180122 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 08:32:50.180193 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 08:32:50.180256 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":73}
I20260808 08:32:50.180699 10371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.175466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45191 (local address 127.25.170.3:40035)
0808 08:32:50.175856 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:50.175870 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:32:50.175994 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:32:50.176396 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:32:50.176398 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:32:50.176417 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:32:50.176530 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.176535 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.177592 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.177599 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.179074 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:32:50.179088 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.179719 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.179723 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:32:50.179826 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.179849 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:32:50.180472 (+ 623us) client_negotiation.cc:240] Negotiation successful
0808 08:32:50.180564 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":2,"thread_start_us":133,"threads_started":1}
I20260808 08:32:50.181052 10356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.175194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:34095 (local address 127.25.170.2:37931)
0808 08:32:50.175818 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:50.175823 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:50.175839 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:32:50.175926 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:50.175933 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:50.175992 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:50.176067 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:32:50.176452 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.177363 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.179111 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.179831 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.179984 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.180046 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:50.180827 (+ 781us) server_negotiation.cc:299] Negotiation successful
0808 08:32:50.180914 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527}
I20260808 08:32:50.182126 10000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d456545458fd4c429a23fcbc444f2d0a" candidate_uuid: "cd987bc85f934d5487b9b290795760cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9307344866e44460974efd72b18e534a" is_pre_election: true
I20260808 08:32:50.181751 10141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d456545458fd4c429a23fcbc444f2d0a" candidate_uuid: "cd987bc85f934d5487b9b290795760cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbd2878e91a147af956b939ef3b5404e" is_pre_election: true
I20260808 08:32:50.182449 10000 raft_consensus.cc:2454] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd987bc85f934d5487b9b290795760cb in term 0.
I20260808 08:32:50.182449 10141 raft_consensus.cc:2454] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd987bc85f934d5487b9b290795760cb in term 0.
I20260808 08:32:50.182950 10218 leader_election.cc:302] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9307344866e44460974efd72b18e534a, cd987bc85f934d5487b9b290795760cb; no voters:
I20260808 08:32:50.183295 10368 raft_consensus.cc:2781] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:32:50.183421 10368 raft_consensus.cc:482] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:32:50.183465 10368 raft_consensus.cc:3037] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:50.185190 10368 raft_consensus.cc:504] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:32:50.185654 10368 leader_election.cc:288] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [CANDIDATE]: Term 1 election: Requested vote from peers fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931), 9307344866e44460974efd72b18e534a (127.25.170.1:45191)
I20260808 08:32:50.186165 10000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d456545458fd4c429a23fcbc444f2d0a" candidate_uuid: "cd987bc85f934d5487b9b290795760cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9307344866e44460974efd72b18e534a"
I20260808 08:32:50.186354 10000 raft_consensus.cc:3037] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:50.187523 10000 raft_consensus.cc:2454] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd987bc85f934d5487b9b290795760cb in term 1.
I20260808 08:32:50.187840 10218 leader_election.cc:302] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9307344866e44460974efd72b18e534a, cd987bc85f934d5487b9b290795760cb; no voters:
I20260808 08:32:50.188040 10368 raft_consensus.cc:2781] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:32:50.188071 10141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d456545458fd4c429a23fcbc444f2d0a" candidate_uuid: "cd987bc85f934d5487b9b290795760cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbd2878e91a147af956b939ef3b5404e"
I20260808 08:32:50.188230 10141 raft_consensus.cc:3037] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:32:50.188452 10368 raft_consensus.cc:686] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 1 LEADER]: Becoming Leader. State: Replica: cd987bc85f934d5487b9b290795760cb, State: Running, Role: LEADER
I20260808 08:32:50.188818 10368 consensus_queue.cc:237] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:32:50.189564 10141 raft_consensus.cc:2454] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd987bc85f934d5487b9b290795760cb in term 1.
I20260808 08:32:50.192447 9842 catalog_manager.cc:5495] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb reported cstate change: term changed from 0 to 1, leader changed from <none> to cd987bc85f934d5487b9b290795760cb (127.25.170.3). New cstate: current_term: 1 leader_uuid: "cd987bc85f934d5487b9b290795760cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } health_report { overall_health: HEALTHY } } }
I20260808 08:32:50.219444 10358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.214611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54092 (local address 127.25.170.3:35657)
0808 08:32:50.214754 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:32:50.214759 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:32:50.214778 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:32:50.214979 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:32:50.214982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:32:50.215048 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:32:50.215160 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:32:50.215490 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.216272 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.217472 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:32:50.217854 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:32:50.217974 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:32:50.218354 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:32:50.218978 (+ 624us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:32:50.219121 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:32:50.219174 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 08:32:50.219245 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:32:50.225700 10141 raft_consensus.cc:1261] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e [term 1 FOLLOWER]: Refusing update from remote peer cd987bc85f934d5487b9b290795760cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:32:50.225709 10000 raft_consensus.cc:1261] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Refusing update from remote peer cd987bc85f934d5487b9b290795760cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:32:50.226402 10372 consensus_queue.cc:1035] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:32:50.226610 10368 consensus_queue.cc:1035] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:32:50.234606 10376 mvcc.cc:205] Tried to move back new op lower bound from 7316184966036639744 to 7316184965896335360. Current Snapshot: MvccSnapshot[applied={T|T < 7316184966036639744}]
I20260808 08:32:50.236172 10375 mvcc.cc:205] Tried to move back new op lower bound from 7316184966036639744 to 7316184965896335360. Current Snapshot: MvccSnapshot[applied={T|T < 7316184966036639744}]
I20260808 08:32:50.244168 9843 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:32:50.244345 9843 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:32:50.246742 9843 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Sending DeleteTablet for 3 replicas of tablet d456545458fd4c429a23fcbc444f2d0a
I20260808 08:32:50.247561 9979 tablet_service.cc:1514] Processing DeleteTablet for tablet d456545458fd4c429a23fcbc444f2d0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:50 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:37790
I20260808 08:32:50.247537 10267 tablet_service.cc:1514] Processing DeleteTablet for tablet d456545458fd4c429a23fcbc444f2d0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:50 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:54086
I20260808 08:32:50.247550 10119 tablet_service.cc:1514] Processing DeleteTablet for tablet d456545458fd4c429a23fcbc444f2d0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:50 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:54118
I20260808 08:32:50.248049 10387 tablet_replica.cc:330] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: stopping tablet replica
I20260808 08:32:50.248266 10385 tablet_replica.cc:330] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: stopping tablet replica
I20260808 08:32:50.248287 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 9912
I20260808 08:32:50.248356 10387 raft_consensus.cc:2229] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:32:50.248636 10387 raft_consensus.cc:2258] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:32:50.249826 10386 tablet_replica.cc:330] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: stopping tablet replica
I20260808 08:32:50.250175 10386 raft_consensus.cc:2229] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:32:50.250581 10387 ts_tablet_manager.cc:1905] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:32:50.250634 10386 raft_consensus.cc:2258] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:32:50.252419 10386 ts_tablet_manager.cc:1905] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:32:50.253258 10387 ts_tablet_manager.cc:1918] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:32:50.253348 10387 log.cc:1196] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/d456545458fd4c429a23fcbc444f2d0a
I20260808 08:32:50.253680 10387 ts_tablet_manager.cc:1939] T d456545458fd4c429a23fcbc444f2d0a P fbd2878e91a147af956b939ef3b5404e: Deleting consensus metadata
I20260808 08:32:50.254900 9828 catalog_manager.cc:4841] TS fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931): tablet d456545458fd4c429a23fcbc444f2d0a (table test-table [id=490b9a14ec8c4fb99be13ed52475bf7e]) successfully deleted
I20260808 08:32:50.256243 10386 ts_tablet_manager.cc:1918] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:32:50.256352 10386 log.cc:1196] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/d456545458fd4c429a23fcbc444f2d0a
I20260808 08:32:50.256681 10386 ts_tablet_manager.cc:1939] T d456545458fd4c429a23fcbc444f2d0a P cd987bc85f934d5487b9b290795760cb: Deleting consensus metadata
I20260808 08:32:50.257664 9825 catalog_manager.cc:4841] TS cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657): tablet d456545458fd4c429a23fcbc444f2d0a (table test-table [id=490b9a14ec8c4fb99be13ed52475bf7e]) successfully deleted
W20260808 08:32:50.263989 9828 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:45191 (error 108)
I20260808 08:32:50.264855 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 10053
I20260808 08:32:50.264979 10359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:32:50.264681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45191 (local address 127.0.0.1:37802)
0808 08:32:50.264829 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 08:32:50.264897 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:45191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:32:50.266963 9828 catalog_manager.cc:4584] TS 9307344866e44460974efd72b18e534a (127.25.170.1:45191): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d456545458fd4c429a23fcbc444f2d0a: Network error: Client connection negotiation failed: client connection to 127.25.170.1:45191: connect: Connection refused (error 111)
I20260808 08:32:50.272481 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 10197
I20260808 08:32:50.280611 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 9809
I20260808 08:33:10.288617 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39679
--webserver_interface=127.25.170.62
--webserver_port=41925
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:39679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:10.413450 10389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:10.413693 10389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:10.413828 10389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:10.417820 10389 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:33:10.417865 10389 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:33:10.417881 10389 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:33:10.417896 10389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:10.417934 10389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:10.417968 10389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:10.418001 10389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:10.418038 10389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:10.423110 10389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:39679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=41925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:10.424209 10389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:10.425240 10389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:33:10.439568 10389 server_base.cc:1034] running on GCE node
W20260808 08:33:10.439520 10397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:10.439522 10398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:10.439520 10400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:10.440490 10389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:10.441655 10389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:10.442834 10389 hybrid_clock.cc:648] HybridClock initialized: now 1786177990442820 us; error 33 us; skew 500 ppm
Aug 08 08:33:10 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177990, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:10.445719 10389 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:33:10.446619 10389 webserver.cc:460] Webserver started at http://127.25.170.62:41925/ using document root <none> and password file <none>
I20260808 08:33:10.447189 10389 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:10.447295 10389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:10.451244 10389 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:10.453473 10407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:10.454782 10389 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:33:10.454912 10389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "1d2d5e3d02ab4848a111ab17e52dc51c"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "11151367f18c161033dff820b837a7c3"
server_key_iv: "ec6b296f080594e19e219e014140d08b"
server_key_version: "encryptionkey@0"
I20260808 08:33:10.455518 10389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:10.475531 10389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:10.478358 10389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:10.478564 10389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:10.485715 10389 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:39679
I20260808 08:33:10.486038 10465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:39679 every 8 connection(s)
I20260808 08:33:10.486814 10389 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:10.488458 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 10389
I20260808 08:33:10.488976 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:45191
--local_ip_for_outbound_sockets=127.25.170.1
--tserver_master_addrs=127.25.170.62:39679
--webserver_port=43949
--webserver_interface=127.25.170.1
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:33:10.492395 10466 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:33:10.495106 10466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Bootstrap starting.
I20260808 08:33:10.520026 10466 log.cc:824] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:10.531186 10466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:33:10.531632 10466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Bootstrap complete.
I20260808 08:33:10.537588 10466 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:33:10.538151 10466 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d2d5e3d02ab4848a111ab17e52dc51c, State: Initialized, Role: FOLLOWER
I20260808 08:33:10.538731 10466 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:33:10.538897 10466 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:10.538975 10466 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:10.539073 10466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:33:10.541674 10466 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:33:10.542063 10466 leader_election.cc:302] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d2d5e3d02ab4848a111ab17e52dc51c; no voters:
I20260808 08:33:10.542440 10466 leader_election.cc:288] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:33:10.542546 10470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:33:10.542817 10470 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 2 LEADER]: Becoming Leader. State: Replica: 1d2d5e3d02ab4848a111ab17e52dc51c, State: Running, Role: LEADER
I20260808 08:33:10.543176 10470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:33:10.543753 10466 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:10.544516 10472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d2d5e3d02ab4848a111ab17e52dc51c. Latest consensus state: current_term: 2 leader_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } } }
I20260808 08:33:10.544636 10472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:10.545332 10471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } } }
I20260808 08:33:10.545421 10471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:10.546061 10478 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:10.550688 10478 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:10.551322 10478 catalog_manager.cc:1259] Loaded cluster ID: be92c5cecbc140f4abf23103c916fc24
I20260808 08:33:10.551383 10478 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:10.553931 10478 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:10.554629 10478 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Loaded TSK: 0
I20260808 08:33:10.573659 10478 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Generated new TSK 1
I20260808 08:33:10.574012 10478 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:33:10.625612 10468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:10.625900 10468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:10.625972 10468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:10.630075 10468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:10.630156 10468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:10.630249 10468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:33:10.635455 10468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:45191
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=43949
--tserver_master_addrs=127.25.170.62:39679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:10.636548 10468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:10.637617 10468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:10.648176 10495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:10.648193 10496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:10.648260 10468 server_base.cc:1034] running on GCE node
W20260808 08:33:10.648572 10498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:10.649058 10468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:10.649817 10468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:10.651007 10468 hybrid_clock.cc:648] HybridClock initialized: now 1786177990650984 us; error 31 us; skew 500 ppm
Aug 08 08:33:10 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177990, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:10.654347 10468 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:33:10.655220 10468 webserver.cc:460] Webserver started at http://127.25.170.1:43949/ using document root <none> and password file <none>
I20260808 08:33:10.655784 10468 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:10.655922 10468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:10.660189 10468 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:33:10.662516 10505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:10.664110 10468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:10.664242 10468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "9307344866e44460974efd72b18e534a"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "78926e66c20b9f1c354a008982c4b1d6"
server_key_iv: "c0716c4cede5b8fc9ce0e20e5e36362a"
server_key_version: "encryptionkey@0"
I20260808 08:33:10.664806 10468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:10.680330 10468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:10.683420 10468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:10.683641 10468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:10.684324 10468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:10.685443 10514 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 08:33:10.690836 10468 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 08:33:10.690913 10468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 08:33:10.690996 10468 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 08:33:10.692739 10468 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 08:33:10.692831 10468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260808 08:33:10.693073 10514 tablet_bootstrap.cc:492] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Bootstrap starting.
I20260808 08:33:10.703985 10468 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:45191
I20260808 08:33:10.704147 10627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:45191 every 8 connection(s)
I20260808 08:33:10.705065 10468 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:10.708137 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 10468
I20260808 08:33:10.708611 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:37931
--local_ip_for_outbound_sockets=127.25.170.2
--tserver_master_addrs=127.25.170.62:39679
--webserver_port=41585
--webserver_interface=127.25.170.2
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:33:10.714589 10514 log.cc:824] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:33:10 dist-test-slave-zkpd krb5kdc[9795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177990, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:10.722383 10514 tablet_bootstrap.cc:492] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:33:10.722923 10514 tablet_bootstrap.cc:492] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Bootstrap complete.
I20260808 08:33:10.724395 10514 ts_tablet_manager.cc:1397] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.020s
I20260808 08:33:10.726070 10631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:10.707333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:34787)
0808 08:33:10.708013 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:10.708071 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:10.709330 (+ 1259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:10.710878 (+ 1548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:10.710890 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:10.711410 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:10.712085 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:10.712103 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.713976 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.713983 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:10.715502 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:10.715517 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.716497 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.716503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:10.716752 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:10.717518 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:10.717545 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:10.719575 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:10.722482 (+ 2907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:10.722490 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:10.722502 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:10.722911 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:10.723378 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:10.723384 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:10.723390 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:10.723578 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:10.724327 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:10.724332 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:10.724630 (+ 298us) client_negotiation.cc:769] Sending connection context
0808 08:33:10.724820 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 08:33:10.725143 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":160,"threads_started":1}
I20260808 08:33:10.726076 10630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:10.707368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:34787 (local address 127.25.170.62:39679)
0808 08:33:10.707791 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:10.707812 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:10.709658 (+ 1846us) server_negotiation.cc:407] Connection header received
0808 08:33:10.709941 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:10.709956 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:10.710370 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:10.710792 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:10.712275 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.713799 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.715649 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.716342 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.716520 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:10.719830 (+ 3310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:10.719840 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:10.719860 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:10.719933 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:10.722343 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:10.723080 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:10.723088 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:10.723097 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:10.723264 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:10.723685 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:10.723688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:10.723690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:10.724191 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:10.724323 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:10.724973 (+ 650us) server_negotiation.cc:299] Negotiation successful
0808 08:33:10.725268 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":139,"threads_started":1}
I20260808 08:33:10.727430 10514 raft_consensus.cc:348] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:33:10.727967 10514 raft_consensus.cc:729] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9307344866e44460974efd72b18e534a, State: Initialized, Role: FOLLOWER
I20260808 08:33:10.728448 10514 consensus_queue.cc:260] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } }
I20260808 08:33:10.729332 10628 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39679
I20260808 08:33:10.729494 10514 ts_tablet_manager.cc:1428] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260808 08:33:10.729573 10628 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:10.730181 10628 heartbeater.cc:511] Master 127.25.170.62:39679 requested a full tablet report, sending...
I20260808 08:33:10.732885 10426 ts_manager.cc:194] Registered new tserver with Master: 9307344866e44460974efd72b18e534a (127.25.170.1:45191)
I20260808 08:33:10.736824 10426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:34787
I20260808 08:33:10.739537 10628 heartbeater.cc:503] Master 127.25.170.62:39679 was elected leader, sending a full tablet report...
Aug 08 08:33:10 dist-test-slave-zkpd krb5kdc[9795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177990, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.1@KRBTEST.COM
I20260808 08:33:10.746384 10636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:10.736187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40242 (local address 127.25.170.1:45191)
0808 08:33:10.736550 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:10.736561 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:10.736913 (+ 352us) server_negotiation.cc:407] Connection header received
0808 08:33:10.737185 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:10.737195 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:10.737344 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:10.737485 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:10.738158 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.738924 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.739809 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.740297 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.740400 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:10.742735 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:10.742750 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:10.742760 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:10.742782 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:10.744422 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:10.744907 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:10.744917 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:10.744919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:10.745020 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:10.745301 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:10.745305 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:10.745307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:10.745549 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:10.745698 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:10.746129 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 08:33:10.746264 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":275,"thread_start_us":98,"threads_started":1}
I20260808 08:33:10.746411 10637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:10.736147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45191 (local address 127.0.0.1:40242)
0808 08:33:10.736792 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:10.736824 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:10.737039 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:10.737485 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:10.737490 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:10.737923 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:10.738026 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:10.738032 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.739033 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.739038 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:10.739684 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:10.739697 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.740431 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.740435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:10.740550 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:10.741168 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:10.741183 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:10.742602 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:10.744532 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:10.744543 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:10.744548 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:10.744801 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:10.745115 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:10.745118 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:10.745121 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:10.745211 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:10.745710 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:10.745716 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:10.745877 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 08:33:10.746035 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 08:33:10.746246 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":128,"threads_started":1}
I20260808 08:33:10.747387 10560 tablet_service.cc:1514] Processing DeleteTablet for tablet d456545458fd4c429a23fcbc444f2d0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:32:50 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:40242
I20260808 08:33:10.748394 10638 tablet_replica.cc:330] stopping tablet replica
I20260808 08:33:10.748692 10638 raft_consensus.cc:2229] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:10.748941 10638 raft_consensus.cc:2258] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:10.749853 10638 ts_tablet_manager.cc:1905] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:10.753374 10638 ts_tablet_manager.cc:1918] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:10.753484 10638 log.cc:1196] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal/wals/d456545458fd4c429a23fcbc444f2d0a
I20260808 08:33:10.753752 10638 ts_tablet_manager.cc:1939] T d456545458fd4c429a23fcbc444f2d0a P 9307344866e44460974efd72b18e534a: Deleting consensus metadata
I20260808 08:33:10.755641 10410 catalog_manager.cc:4841] TS 9307344866e44460974efd72b18e534a (127.25.170.1:45191): tablet d456545458fd4c429a23fcbc444f2d0a (table test-table [id=490b9a14ec8c4fb99be13ed52475bf7e]) successfully deleted
W20260808 08:33:10.833425 10632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:10.833657 10632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:10.833712 10632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:10.837617 10632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:10.837666 10632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:10.837755 10632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:33:10.842815 10632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:37931
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=41585
--tserver_master_addrs=127.25.170.62:39679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:10.843868 10632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:10.844928 10632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:10.854140 10643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:10.854140 10646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:10.854137 10644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:10.854452 10632 server_base.cc:1034] running on GCE node
I20260808 08:33:10.854861 10632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:10.855489 10632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:10.856665 10632 hybrid_clock.cc:648] HybridClock initialized: now 1786177990856639 us; error 42 us; skew 500 ppm
Aug 08 08:33:10 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177990, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:10.859490 10632 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:33:10.860404 10632 webserver.cc:460] Webserver started at http://127.25.170.2:41585/ using document root <none> and password file <none>
I20260808 08:33:10.860968 10632 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:10.861075 10632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:10.865010 10632 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:10.867184 10654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:10.868624 10632 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:10.868763 10632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "fbd2878e91a147af956b939ef3b5404e"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "0e56e32b6e3e2f3e73d25680d8622bea"
server_key_iv: "ea09c47608766cbb810305f8df6a5e4b"
server_key_version: "encryptionkey@0"
I20260808 08:33:10.869380 10632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:10.890362 10632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:10.893146 10632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:10.893298 10632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:10.893841 10632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:10.894622 10632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:10.894668 10632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:10.894707 10632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:10.894729 10632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:10.904233 10632 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:37931
I20260808 08:33:10.904277 10773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:37931 every 8 connection(s)
I20260808 08:33:10.905231 10632 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:10.908156 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 10632
I20260808 08:33:10.908598 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:35657
--local_ip_for_outbound_sockets=127.25.170.3
--tserver_master_addrs=127.25.170.62:39679
--webserver_port=40305
--webserver_interface=127.25.170.3
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:33:10 dist-test-slave-zkpd krb5kdc[9795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177990, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:10.919647 10630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:10.906907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:47767 (local address 127.25.170.62:39679)
0808 08:33:10.907045 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:10.907049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:10.907849 (+ 800us) server_negotiation.cc:407] Connection header received
0808 08:33:10.909288 (+ 1439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:10.909292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:10.909356 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:10.909460 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:10.910595 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.911210 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.912423 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.912662 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.912783 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:10.915697 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:10.915700 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:10.915702 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:10.915728 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:10.917273 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:10.917952 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:10.917955 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:10.917956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:10.918037 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:10.918453 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:10.918455 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:10.918456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:10.918631 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:10.918708 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:10.919403 (+ 695us) server_negotiation.cc:299] Negotiation successful
0808 08:33:10.919520 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:33:10.920943 10777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:10.907266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:47767)
0808 08:33:10.907699 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:10.907741 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:10.909079 (+ 1338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:10.909630 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:10.909636 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:10.909984 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:10.910448 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:10.910462 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.911351 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.911354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:10.912295 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:10.912306 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:10.912816 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:10.912820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:10.912989 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:10.913612 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:10.913632 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:10.915513 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:10.917394 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:10.917401 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:10.917419 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:10.917818 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:10.918130 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:10.918134 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:10.918137 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:10.918356 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:10.918739 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:10.918746 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:10.919102 (+ 356us) client_negotiation.cc:769] Sending connection context
0808 08:33:10.919334 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 08:33:10.919717 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":116,"threads_started":1}
I20260808 08:33:10.922168 10774 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39679
I20260808 08:33:10.922535 10774 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:10.923027 10774 heartbeater.cc:511] Master 127.25.170.62:39679 requested a full tablet report, sending...
I20260808 08:33:10.924096 10426 ts_manager.cc:194] Registered new tserver with Master: fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931)
I20260808 08:33:10.924670 10426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:47767
W20260808 08:33:11.024750 10778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:11.025013 10778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:11.025098 10778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:11.029043 10778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:11.029114 10778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:11.029191 10778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:33:11.034281 10778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:35657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=40305
--tserver_master_addrs=127.25.170.62:39679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:11.035293 10778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:11.036374 10778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:11.045383 10788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:11.045451 10786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:11.045492 10785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:11.046111 10778 server_base.cc:1034] running on GCE node
I20260808 08:33:11.046474 10778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:11.047037 10778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:11.048211 10778 hybrid_clock.cc:648] HybridClock initialized: now 1786177991048192 us; error 41 us; skew 500 ppm
Aug 08 08:33:11 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177991, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:11.051062 10778 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:33:11.051985 10778 webserver.cc:460] Webserver started at http://127.25.170.3:40305/ using document root <none> and password file <none>
I20260808 08:33:11.052548 10778 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:11.052645 10778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:11.056578 10778 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:11.058629 10795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:11.059978 10778 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:11.060071 10778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "cd987bc85f934d5487b9b290795760cb"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "e51d2ebdec8a8841ae070d2ca71c8c16"
server_key_iv: "510e36972d20499dd203ae289fa0a5a8"
server_key_version: "encryptionkey@0"
I20260808 08:33:11.060570 10778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:11.076900 10778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:11.079487 10778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:11.079674 10778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:11.080302 10778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:11.081084 10778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:11.081131 10778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:11.081193 10778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:11.081228 10778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:11.090276 10778 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:35657
I20260808 08:33:11.090299 10913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:35657 every 8 connection(s)
I20260808 08:33:11.091228 10778 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:11.095772 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 10778
Aug 08 08:33:11 dist-test-slave-zkpd krb5kdc[9795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786177991, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:11.105818 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.096466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57094 (local address 127.25.170.62:39679)
0808 08:33:11.096724 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:11.096730 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:11.096888 (+ 158us) server_negotiation.cc:407] Connection header received
0808 08:33:11.097013 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:11.097015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:11.097051 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:11.097126 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:11.098021 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.098797 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.099939 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.100256 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.100385 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.102141 (+ 1756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:11.102145 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:11.102149 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:11.102172 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:11.103958 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:11.104433 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:11.104436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:11.104438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:11.104526 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:11.104898 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:11.104913 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:11.104915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:11.105129 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:11.105299 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:11.105534 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 08:33:11.105649 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":96,"threads_started":1}
I20260808 08:33:11.106307 10630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.092996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:55295 (local address 127.25.170.62:39679)
0808 08:33:11.093123 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:11.093126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:11.093940 (+ 814us) server_negotiation.cc:407] Connection header received
0808 08:33:11.095163 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:11.095166 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:11.095215 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:11.095304 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:11.096785 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.097598 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.099114 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.099454 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.099558 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.102322 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:11.102326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:11.102329 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:11.102382 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:11.104146 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:11.104725 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:11.104730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:11.104731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:11.104825 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:11.105209 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:11.105212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:11.105213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:11.105409 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:11.105506 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:11.106071 (+ 565us) server_negotiation.cc:299] Negotiation successful
0808 08:33:11.106176 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:33:11.107164 10916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.093357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:55295)
0808 08:33:11.093799 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:11.093839 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:11.094956 (+ 1117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:11.095460 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:11.095466 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:11.096010 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:11.096598 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:11.096620 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.097729 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.097732 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:11.099006 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:11.099015 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.099587 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.099589 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:11.099722 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.100283 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:11.100305 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:11.102145 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:11.104255 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:11.104260 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:11.104271 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:11.104618 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:11.104925 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:11.104928 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:11.104930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:11.105087 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:11.105517 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:11.105523 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:11.105793 (+ 270us) client_negotiation.cc:769] Sending connection context
0808 08:33:11.106031 (+ 238us) client_negotiation.cc:240] Negotiation successful
0808 08:33:11.106336 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":125,"threads_started":1}
I20260808 08:33:11.108316 10914 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39679
I20260808 08:33:11.108510 10914 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:11.108923 10914 heartbeater.cc:511] Master 127.25.170.62:39679 requested a full tablet report, sending...
I20260808 08:33:11.109826 10426 ts_manager.cc:194] Registered new tserver with Master: cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657)
I20260808 08:33:11.110387 10426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:55295
I20260808 08:33:11.119179 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:33:11.122872 10630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.119753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57100 (local address 127.25.170.62:39679)
0808 08:33:11.119883 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:11.119887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:11.120105 (+ 218us) server_negotiation.cc:407] Connection header received
0808 08:33:11.120227 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:11.120229 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:11.120325 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:11.120408 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:11.120596 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.121070 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.121846 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.122042 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.122117 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.122403 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:11.122521 (+ 118us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 08:33:11.122737 (+ 216us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57100: token expired
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 08:33:11.122947 10630 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57100: token expired
W20260808 08:33:11.123293 10346 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.25.170.62:39679)
I20260808 08:33:11.129684 10630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.123607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57104 (local address 127.25.170.62:39679)
0808 08:33:11.123708 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:11.123711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:11.123739 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:33:11.123841 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:11.123843 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:11.123876 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:11.123976 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:11.124520 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.124962 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.125677 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.125863 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.125934 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.127123 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:11.127125 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:11.127127 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:11.127148 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:11.128427 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:11.128809 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:11.128811 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:11.128812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:11.128879 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:11.129094 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:11.129096 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:11.129097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:11.129236 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:11.129329 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:11.129508 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 08:33:11.129590 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 08:33:11.131781 10426 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:11.134964 10426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:11.142580 10560 tablet_service.cc:1467] Processing CreateTablet for tablet 7843138e9ebe40ea9a980b8e01d0d7e1 (DEFAULT_TABLE table=test-table [id=c02c22790094448cbaa3261e5440256f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:11.143324 10560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7843138e9ebe40ea9a980b8e01d0d7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:11.146333 10514 tablet_bootstrap.cc:492] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Bootstrap starting.
I20260808 08:33:11.146888 10637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.141465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:37931 (local address 127.0.0.1:54556)
0808 08:33:11.141597 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:11.141612 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:11.141687 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:11.142680 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:11.142683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:11.142702 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:11.142799 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:11.142805 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.144218 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.144222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:11.145331 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:11.145342 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.146468 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.146472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:11.146574 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.146621 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 08:33:11.146681 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 08:33:11.146771 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 08:33:11.147269 10514 tablet_bootstrap.cc:654] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:11.147264 10925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.141734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:35657 (local address 127.0.0.1:57300)
0808 08:33:11.142295 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:11.142311 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:11.142398 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:11.142988 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:11.142993 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:11.143015 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:11.143096 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:11.143101 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.144488 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.144492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:11.145638 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:11.145649 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.146802 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.146806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:11.146916 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.146940 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:33:11.147018 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 08:33:11.147086 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":105,"threads_started":1}
I20260808 08:33:11.147691 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.141661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54556 (local address 127.25.170.2:37931)
0808 08:33:11.142152 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:11.142164 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:11.142189 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:33:11.142273 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:11.142279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:11.142511 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:11.142680 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:11.142887 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.144093 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.145541 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.146308 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.147068 (+ 760us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.147209 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:11.147252 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 08:33:11.147347 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":161,"threads_started":1}
I20260808 08:33:11.147841 10926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.142008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57300 (local address 127.25.170.3:35657)
0808 08:33:11.142375 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:11.142385 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:11.142404 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:33:11.142505 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:11.142510 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:11.142694 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:11.142896 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:11.143258 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.144347 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.145777 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.146670 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.146771 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.146918 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:11.147505 (+ 587us) server_negotiation.cc:299] Negotiation successful
0808 08:33:11.147649 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":82,"threads_started":1}
I20260808 08:33:11.149235 10514 tablet_bootstrap.cc:492] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: No bootstrap required, opened a new log
I20260808 08:33:11.149334 10514 ts_tablet_manager.cc:1397] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 08:33:11.149782 10514 raft_consensus.cc:348] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:11.149909 10514 raft_consensus.cc:374] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:11.149952 10514 raft_consensus.cc:729] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9307344866e44460974efd72b18e534a, State: Initialized, Role: FOLLOWER
I20260808 08:33:11.150069 10514 consensus_queue.cc:260] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:11.150336 10514 ts_tablet_manager.cc:1428] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 08:33:11.150772 10846 tablet_service.cc:1467] Processing CreateTablet for tablet 7843138e9ebe40ea9a980b8e01d0d7e1 (DEFAULT_TABLE table=test-table [id=c02c22790094448cbaa3261e5440256f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:11.151284 10704 tablet_service.cc:1467] Processing CreateTablet for tablet 7843138e9ebe40ea9a980b8e01d0d7e1 (DEFAULT_TABLE table=test-table [id=c02c22790094448cbaa3261e5440256f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:11.151978 10846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7843138e9ebe40ea9a980b8e01d0d7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:11.152210 10704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7843138e9ebe40ea9a980b8e01d0d7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:11.158969 10928 tablet_bootstrap.cc:492] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: Bootstrap starting.
I20260808 08:33:11.159277 10929 tablet_bootstrap.cc:492] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: Bootstrap starting.
I20260808 08:33:11.161065 10928 tablet_bootstrap.cc:654] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:11.161478 10929 tablet_bootstrap.cc:654] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:11.162171 10929 log.cc:824] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:11.162173 10928 log.cc:824] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:11.164199 10928 tablet_bootstrap.cc:492] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: No bootstrap required, opened a new log
I20260808 08:33:11.164258 10929 tablet_bootstrap.cc:492] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: No bootstrap required, opened a new log
I20260808 08:33:11.164426 10928 ts_tablet_manager.cc:1397] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260808 08:33:11.164465 10929 ts_tablet_manager.cc:1397] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:33:11.167228 10928 raft_consensus.cc:348] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:11.167455 10928 raft_consensus.cc:374] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:11.167490 10928 raft_consensus.cc:729] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd987bc85f934d5487b9b290795760cb, State: Initialized, Role: FOLLOWER
I20260808 08:33:11.167562 10929 raft_consensus.cc:348] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:11.167889 10929 raft_consensus.cc:374] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:11.167984 10929 raft_consensus.cc:729] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbd2878e91a147af956b939ef3b5404e, State: Initialized, Role: FOLLOWER
I20260808 08:33:11.168187 10928 consensus_queue.cc:260] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:11.168462 10929 consensus_queue.cc:260] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:11.169234 10928 ts_tablet_manager.cc:1428] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:33:11.169253 10774 heartbeater.cc:503] Master 127.25.170.62:39679 was elected leader, sending a full tablet report...
I20260808 08:33:11.169504 10929 ts_tablet_manager.cc:1428] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260808 08:33:11.169593 10914 heartbeater.cc:503] Master 127.25.170.62:39679 was elected leader, sending a full tablet report...
W20260808 08:33:11.206321 10629 tablet.cc:2369] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:33:11.342321 10915 tablet.cc:2369] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:33:11.406369 10775 tablet.cc:2369] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:11.455833 10932 raft_consensus.cc:482] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:11.456127 10932 raft_consensus.cc:504] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:11.457357 10932 leader_election.cc:288] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931), 9307344866e44460974efd72b18e534a (127.25.170.1:45191)
I20260808 08:33:11.462785 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.457662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:55073 (local address 127.25.170.2:37931)
0808 08:33:11.457793 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:11.457796 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:11.457828 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:33:11.457943 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:11.457946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:11.458005 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:11.458088 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:11.458434 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.459361 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.461245 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.462011 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.462171 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.462251 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:11.462570 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 08:33:11.462655 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 08:33:11.462809 10916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.457568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:37931 (local address 127.25.170.3:55073)
0808 08:33:11.457695 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:11.457709 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:11.457816 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:11.458106 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:11.458110 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:11.458132 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:11.458283 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:11.458292 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.459512 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.459517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:11.461080 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:11.461094 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.462182 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.462187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:11.462411 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.462464 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 08:33:11.462553 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 08:33:11.462632 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":82}
I20260808 08:33:11.463676 10724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7843138e9ebe40ea9a980b8e01d0d7e1" candidate_uuid: "cd987bc85f934d5487b9b290795760cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbd2878e91a147af956b939ef3b5404e" is_pre_election: true
I20260808 08:33:11.464056 10724 raft_consensus.cc:2454] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd987bc85f934d5487b9b290795760cb in term 0.
I20260808 08:33:11.464239 10934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.457878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45191 (local address 127.25.170.3:37589)
0808 08:33:11.458375 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:11.458389 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:11.458496 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:11.459412 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:11.459416 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:11.459441 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:11.459616 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:11.459627 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.460821 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.460826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:11.462380 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:11.462395 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.463677 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.463680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:11.463849 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.463875 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:33:11.463980 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 08:33:11.464052 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":92,"thread_start_us":127,"threads_started":1}
I20260808 08:33:11.464615 10935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.458024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:37589 (local address 127.25.170.1:45191)
0808 08:33:11.458896 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:11.458900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:11.458915 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:33:11.459015 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:11.459018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:11.459094 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:11.459249 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:11.459766 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.460664 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.462557 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.463529 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.463658 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.463868 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:11.464396 (+ 528us) server_negotiation.cc:299] Negotiation successful
0808 08:33:11.464481 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":797,"thread_start_us":661,"threads_started":1}
I20260808 08:33:11.464577 10798 leader_election.cc:302] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd987bc85f934d5487b9b290795760cb, fbd2878e91a147af956b939ef3b5404e; no voters:
I20260808 08:33:11.465009 10932 raft_consensus.cc:2781] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:11.465116 10932 raft_consensus.cc:482] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:11.465170 10932 raft_consensus.cc:3037] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:11.465262 10580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7843138e9ebe40ea9a980b8e01d0d7e1" candidate_uuid: "cd987bc85f934d5487b9b290795760cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9307344866e44460974efd72b18e534a" is_pre_election: true
I20260808 08:33:11.465549 10580 raft_consensus.cc:2454] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd987bc85f934d5487b9b290795760cb in term 0.
I20260808 08:33:11.466708 10932 raft_consensus.cc:504] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:11.467067 10932 leader_election.cc:288] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [CANDIDATE]: Term 1 election: Requested vote from peers fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931), 9307344866e44460974efd72b18e534a (127.25.170.1:45191)
I20260808 08:33:11.467443 10724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7843138e9ebe40ea9a980b8e01d0d7e1" candidate_uuid: "cd987bc85f934d5487b9b290795760cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbd2878e91a147af956b939ef3b5404e"
I20260808 08:33:11.467588 10724 raft_consensus.cc:3037] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:11.467868 10580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7843138e9ebe40ea9a980b8e01d0d7e1" candidate_uuid: "cd987bc85f934d5487b9b290795760cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9307344866e44460974efd72b18e534a"
I20260808 08:33:11.468027 10580 raft_consensus.cc:3037] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:11.468844 10724 raft_consensus.cc:2454] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd987bc85f934d5487b9b290795760cb in term 1.
I20260808 08:33:11.469121 10580 raft_consensus.cc:2454] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd987bc85f934d5487b9b290795760cb in term 1.
I20260808 08:33:11.469163 10798 leader_election.cc:302] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd987bc85f934d5487b9b290795760cb, fbd2878e91a147af956b939ef3b5404e; no voters:
I20260808 08:33:11.469362 10932 raft_consensus.cc:2781] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:11.469583 10932 raft_consensus.cc:686] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 1 LEADER]: Becoming Leader. State: Replica: cd987bc85f934d5487b9b290795760cb, State: Running, Role: LEADER
I20260808 08:33:11.469909 10932 consensus_queue.cc:237] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:11.473011 10425 catalog_manager.cc:5495] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb reported cstate change: term changed from 0 to 1, leader changed from <none> to cd987bc85f934d5487b9b290795760cb (127.25.170.3). New cstate: current_term: 1 leader_uuid: "cd987bc85f934d5487b9b290795760cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260808 08:33:11.512845 10926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.509584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57306 (local address 127.25.170.3:35657)
0808 08:33:11.509718 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:11.509721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:11.509735 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:33:11.509870 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:11.509872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:11.509935 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:11.510030 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:11.510236 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.510731 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.511534 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:11.511730 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:11.511818 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:11.512117 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:11.512479 (+ 362us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:11.512563 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:11.512614 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 08:33:11.512659 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:33:11.518487 10580 raft_consensus.cc:1261] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Refusing update from remote peer cd987bc85f934d5487b9b290795760cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:11.518492 10724 raft_consensus.cc:1261] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e [term 1 FOLLOWER]: Refusing update from remote peer cd987bc85f934d5487b9b290795760cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:11.519182 10932 consensus_queue.cc:1035] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:11.519358 10936 consensus_queue.cc:1035] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:11.525137 10938 mvcc.cc:205] Tried to move back new op lower bound from 7316185053252902912 to 7316185053063331840. Current Snapshot: MvccSnapshot[applied={T|T < 7316185053252902912}]
I20260808 08:33:11.525844 10940 mvcc.cc:205] Tried to move back new op lower bound from 7316185053252902912 to 7316185053063331840. Current Snapshot: MvccSnapshot[applied={T|T < 7316185053252902912}]
I20260808 08:33:11.527329 10941 mvcc.cc:205] Tried to move back new op lower bound from 7316185053252902912 to 7316185053063331840. Current Snapshot: MvccSnapshot[applied={T|T < 7316185053252902912}]
I20260808 08:33:11.534050 10425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:11.534217 10425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:11.536403 10425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Sending DeleteTablet for 3 replicas of tablet 7843138e9ebe40ea9a980b8e01d0d7e1
I20260808 08:33:11.537083 10704 tablet_service.cc:1514] Processing DeleteTablet for tablet 7843138e9ebe40ea9a980b8e01d0d7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:11 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:54556
I20260808 08:33:11.537108 10846 tablet_service.cc:1514] Processing DeleteTablet for tablet 7843138e9ebe40ea9a980b8e01d0d7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:11 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:57300
I20260808 08:33:11.537196 10560 tablet_service.cc:1514] Processing DeleteTablet for tablet 7843138e9ebe40ea9a980b8e01d0d7e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:11 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:40242
I20260808 08:33:11.537576 10948 tablet_replica.cc:330] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: stopping tablet replica
I20260808 08:33:11.537601 10950 tablet_replica.cc:330] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: stopping tablet replica
I20260808 08:33:11.537829 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 10468
I20260808 08:33:11.537876 10948 raft_consensus.cc:2229] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:11.538055 10949 tablet_replica.cc:330] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: stopping tablet replica
I20260808 08:33:11.538219 10948 raft_consensus.cc:2258] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:11.539865 10948 ts_tablet_manager.cc:1905] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:11.542789 10950 raft_consensus.cc:2229] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:11.543162 10948 ts_tablet_manager.cc:1918] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:11.543324 10948 log.cc:1196] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/7843138e9ebe40ea9a980b8e01d0d7e1
I20260808 08:33:11.543315 10950 raft_consensus.cc:2258] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:11.543821 10948 ts_tablet_manager.cc:1939] T 7843138e9ebe40ea9a980b8e01d0d7e1 P cd987bc85f934d5487b9b290795760cb: Deleting consensus metadata
I20260808 08:33:11.545279 10408 catalog_manager.cc:4841] TS cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657): tablet 7843138e9ebe40ea9a980b8e01d0d7e1 (table test-table [id=c02c22790094448cbaa3261e5440256f]) successfully deleted
I20260808 08:33:11.545660 10950 ts_tablet_manager.cc:1905] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:11.549227 10950 ts_tablet_manager.cc:1918] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:11.549358 10950 log.cc:1196] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/7843138e9ebe40ea9a980b8e01d0d7e1
I20260808 08:33:11.549711 10950 ts_tablet_manager.cc:1939] T 7843138e9ebe40ea9a980b8e01d0d7e1 P fbd2878e91a147af956b939ef3b5404e: Deleting consensus metadata
I20260808 08:33:11.551028 10410 catalog_manager.cc:4841] TS fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931): tablet 7843138e9ebe40ea9a980b8e01d0d7e1 (table test-table [id=c02c22790094448cbaa3261e5440256f]) successfully deleted
W20260808 08:33:11.553506 10410 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:45191 (error 108)
I20260808 08:33:11.554157 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 10632
I20260808 08:33:11.557598 10925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:11.557287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:45191 (local address 127.0.0.1:40246)
0808 08:33:11.557426 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:11.557508 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:45191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:33:11.557794 10410 catalog_manager.cc:4584] TS 9307344866e44460974efd72b18e534a (127.25.170.1:45191): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7843138e9ebe40ea9a980b8e01d0d7e1: Network error: Client connection negotiation failed: client connection to 127.25.170.1:45191: connect: Connection refused (error 111)
I20260808 08:33:11.567359 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 10778
I20260808 08:33:11.575387 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 10389
I20260808 08:33:31.583777 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39679
--webserver_interface=127.25.170.62
--webserver_port=41925
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:39679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:31.699486 10952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:31.699779 10952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:31.699848 10952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:31.703756 10952 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:33:31.703833 10952 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:33:31.703862 10952 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:33:31.703895 10952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:31.703958 10952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:31.703997 10952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:31.704033 10952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:31.704069 10952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:31.709226 10952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:39679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=41925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:31.710253 10952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:31.711265 10952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:31.719655 10958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:31.719640 10960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:31.719669 10957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:31.719843 10952 server_base.cc:1034] running on GCE node
I20260808 08:33:31.720644 10952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:31.721695 10952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:31.722892 10952 hybrid_clock.cc:648] HybridClock initialized: now 1786178011722862 us; error 48 us; skew 500 ppm
Aug 08 08:33:31 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178011, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:31.725694 10952 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:33:31.726598 10952 webserver.cc:460] Webserver started at http://127.25.170.62:41925/ using document root <none> and password file <none>
I20260808 08:33:31.727141 10952 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:31.727236 10952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:31.731010 10952 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:31.733225 10967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:31.734442 10952 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:33:31.734587 10952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "1d2d5e3d02ab4848a111ab17e52dc51c"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "11151367f18c161033dff820b837a7c3"
server_key_iv: "ec6b296f080594e19e219e014140d08b"
server_key_version: "encryptionkey@0"
I20260808 08:33:31.735144 10952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:31.754376 10952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:31.757644 10952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:31.757853 10952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:31.765411 10952 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:39679
I20260808 08:33:31.765632 11025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:39679 every 8 connection(s)
I20260808 08:33:31.766541 10952 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:31.770835 11026 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:33:31.771620 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 10952
I20260808 08:33:31.772162 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:45191
--local_ip_for_outbound_sockets=127.25.170.1
--tserver_master_addrs=127.25.170.62:39679
--webserver_port=43949
--webserver_interface=127.25.170.1
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:33:31.772904 11026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Bootstrap starting.
I20260808 08:33:31.791455 11026 log.cc:824] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:31.802392 11026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:33:31.802747 11026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Bootstrap complete.
I20260808 08:33:31.806802 11026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:33:31.807194 11026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d2d5e3d02ab4848a111ab17e52dc51c, State: Initialized, Role: FOLLOWER
I20260808 08:33:31.807680 11026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:33:31.807823 11026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:31.807930 11026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:31.808059 11026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 2 FOLLOWER]: Advancing to term 3
I20260808 08:33:31.809820 11026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:33:31.810139 11026 leader_election.cc:302] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d2d5e3d02ab4848a111ab17e52dc51c; no voters:
I20260808 08:33:31.810465 11026 leader_election.cc:288] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 08:33:31.810546 11030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 3 FOLLOWER]: Leader election won for term 3
I20260808 08:33:31.810763 11030 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [term 3 LEADER]: Becoming Leader. State: Replica: 1d2d5e3d02ab4848a111ab17e52dc51c, State: Running, Role: LEADER
I20260808 08:33:31.811060 11030 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } }
I20260808 08:33:31.811681 11026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:31.811992 11030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } } }
I20260808 08:33:31.812119 11030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:31.812495 11031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d2d5e3d02ab4848a111ab17e52dc51c. Latest consensus state: current_term: 3 leader_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2d5e3d02ab4848a111ab17e52dc51c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39679 } } }
I20260808 08:33:31.812709 11031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:31.812475 11034 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:31.818228 11034 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:31.818943 11034 catalog_manager.cc:1259] Loaded cluster ID: be92c5cecbc140f4abf23103c916fc24
I20260808 08:33:31.819006 11034 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:31.821453 11034 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:31.822182 11034 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Loaded TSK: 0
I20260808 08:33:31.822265 11034 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1d2d5e3d02ab4848a111ab17e52dc51c: Loaded TSK: 1
F20260808 08:33:31.822973 11034 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f86bbdb69ad google::LogMessage::Fail() at ??:0
@ 0x7f86bbdb988a google::LogMessage::SendToLog() at ??:0
@ 0x7f86bbdb64de google::LogMessage::Flush() at ??:0
@ 0x7f86bbdb7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f86bea7a18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f86bea72f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f86c671f7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f86c66f999c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f86c66fa178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f86c673bdf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f86c675a82b std::function<>::operator()() at ??:0
@ 0x7f86c66f9b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f86c66faf3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f86c66f7579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f86c673b640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f86be0083d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f86be008c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f86be00a3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f86bdff9512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f86bf63d6db start_thread at ??:0
@ 0x7f86ba8b461f clone at ??:0
W20260808 08:33:31.925554 11028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:31.925781 11028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:31.925824 11028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:31.929857 11028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:31.929908 11028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:31.929989 11028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:33:31.935075 11028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:45191
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=43949
--tserver_master_addrs=127.25.170.62:39679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:31.936152 11028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:31.937150 11028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:31.947762 11076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:31.947790 11077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:31.947960 11028 server_base.cc:1034] running on GCE node
W20260808 08:33:31.948117 11079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:31.948519 11028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:31.949159 11028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:31.950354 11028 hybrid_clock.cc:648] HybridClock initialized: now 1786178011950320 us; error 55 us; skew 500 ppm
Aug 08 08:33:31 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178011, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:31.953325 11028 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:33:31.954414 11028 webserver.cc:460] Webserver started at http://127.25.170.1:43949/ using document root <none> and password file <none>
I20260808 08:33:31.955133 11028 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:31.955226 11028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:31.960286 11028 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:31.962988 11086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:31.964579 11028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:31.964706 11028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "9307344866e44460974efd72b18e534a"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "78926e66c20b9f1c354a008982c4b1d6"
server_key_iv: "c0716c4cede5b8fc9ce0e20e5e36362a"
server_key_version: "encryptionkey@0"
I20260808 08:33:31.965405 11028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:31.991535 11028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:31.995438 11028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:31.995645 11028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:31.996464 11028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:31.997864 11093 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 08:33:32.002007 11028 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 08:33:32.002084 11028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260808 08:33:32.002151 11028 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 08:33:32.004360 11028 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 08:33:32.004420 11028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:32.004745 11093 tablet_bootstrap.cc:492] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Bootstrap starting.
I20260808 08:33:32.015618 11028 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:45191
I20260808 08:33:32.015755 11211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:45191 every 8 connection(s)
I20260808 08:33:32.016649 11028 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:32.020164 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 11028
I20260808 08:33:32.020602 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:37931
--local_ip_for_outbound_sockets=127.25.170.2
--tserver_master_addrs=127.25.170.62:39679
--webserver_port=41585
--webserver_interface=127.25.170.2
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:33:32.027761 11093 log.cc:824] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:32.036897 11093 tablet_bootstrap.cc:492] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:33:32.037281 11093 tablet_bootstrap.cc:492] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Bootstrap complete.
I20260808 08:33:32.038523 11093 ts_tablet_manager.cc:1397] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Time spent bootstrapping tablet: real 0.034s user 0.010s sys 0.018s
I20260808 08:33:32.041069 11093 raft_consensus.cc:348] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:32.041498 11093 raft_consensus.cc:729] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9307344866e44460974efd72b18e534a, State: Initialized, Role: FOLLOWER
I20260808 08:33:32.041980 11093 consensus_queue.cc:260] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:32.042943 11093 ts_tablet_manager.cc:1428] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a: Time spent starting tablet: real 0.004s user 0.005s sys 0.001s
W20260808 08:33:32.079491 11214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:33:32.018590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:54671)
0808 08:33:32.019082 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.019136 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:32.022773 (+ 3637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:32.078539 (+ 55766us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":153,"threads_started":1}
W20260808 08:33:32.080075 11212 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:39679 (0 consecutive failures): Network error: Failed to ping master at 127.25.170.62:39679: Client connection negotiation failed: client connection to 127.25.170.62:39679: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 08:33:32.080917 11214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.080612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:54651)
0808 08:33:32.080770 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.080850 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 08:33:32.081650 11214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.081420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:35293)
0808 08:33:32.081545 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.081594 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:33:32.081871 11212 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:33:32.154302 11215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:32.154554 11215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:32.154596 11215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:32.158586 11215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:32.158643 11215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:32.158699 11215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:33:32.163793 11215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:37931
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=41585
--tserver_master_addrs=127.25.170.62:39679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:32.164803 11215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:32.165742 11215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:32.175395 11222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:32.175459 11215 server_base.cc:1034] running on GCE node
W20260808 08:33:32.175464 11225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:32.175586 11223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:32.176076 11215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:32.176628 11215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:32.177785 11215 hybrid_clock.cc:648] HybridClock initialized: now 1786178012177767 us; error 30 us; skew 500 ppm
Aug 08 08:33:32 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178012, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:32.180526 11215 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:33:32.181291 11215 webserver.cc:460] Webserver started at http://127.25.170.2:41585/ using document root <none> and password file <none>
I20260808 08:33:32.181785 11215 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:32.181850 11215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:32.185598 11215 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:32.187495 11232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:32.188871 11215 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:32.189038 11215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "fbd2878e91a147af956b939ef3b5404e"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "0e56e32b6e3e2f3e73d25680d8622bea"
server_key_iv: "ea09c47608766cbb810305f8df6a5e4b"
server_key_version: "encryptionkey@0"
I20260808 08:33:32.189575 11215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:32.206081 11215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:32.208841 11215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:32.209071 11215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:32.209648 11215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:32.210465 11215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:32.210538 11215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:32.210608 11215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:32.210651 11215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:32.219774 11215 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:37931
I20260808 08:33:32.219830 11357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:37931 every 8 connection(s)
I20260808 08:33:32.220911 11215 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:32.223009 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 11215
I20260808 08:33:32.223529 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:35657
--local_ip_for_outbound_sockets=127.25.170.3
--tserver_master_addrs=127.25.170.62:39679
--webserver_port=40305
--webserver_interface=127.25.170.3
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:33:32.224850 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.223057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:43019)
0808 08:33:32.223569 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.224161 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":153,"threads_started":1}
W20260808 08:33:32.225401 11358 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:39679 (0 consecutive failures): Network error: Failed to ping master at 127.25.170.62:39679: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
I20260808 08:33:32.226018 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.225794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:54251)
0808 08:33:32.225909 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.225965 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 08:33:32.226706 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.226508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:54303)
0808 08:33:32.226615 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.226657 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 08:33:32.226924 11358 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:33:32.336949 11361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:32.337234 11361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:32.337325 11361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:32.341284 11361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:32.341333 11361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:32.341444 11361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:33:32.346797 11361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:35657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=40305
--tserver_master_addrs=127.25.170.62:39679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:32.347812 11361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:32.348856 11361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:32.358520 11366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:32.358603 11361 server_base.cc:1034] running on GCE node
W20260808 08:33:32.358589 11367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:32.358520 11369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:32.359203 11361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:32.359803 11361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:32.360983 11361 hybrid_clock.cc:648] HybridClock initialized: now 1786178012360943 us; error 48 us; skew 500 ppm
Aug 08 08:33:32 dist-test-slave-zkpd krb5kdc[9795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178012, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:32.363936 11361 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:33:32.364780 11361 webserver.cc:460] Webserver started at http://127.25.170.3:40305/ using document root <none> and password file <none>
I20260808 08:33:32.365279 11361 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:32.365355 11361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:32.369530 11361 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:33:32.371557 11377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:32.373214 11361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:33:32.373346 11361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "cd987bc85f934d5487b9b290795760cb"
format_stamp: "Formatted at 2026-08-08 08:32:49 on dist-test-slave-zkpd"
server_key: "e51d2ebdec8a8841ae070d2ca71c8c16"
server_key_iv: "510e36972d20499dd203ae289fa0a5a8"
server_key_version: "encryptionkey@0"
I20260808 08:33:32.373893 11361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:32.388554 11361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:32.391232 11361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:32.391427 11361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:32.392067 11361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:32.392956 11361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:32.393026 11361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:32.393098 11361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:32.393150 11361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:32.401814 11361 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:35657
I20260808 08:33:32.401892 11500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:35657 every 8 connection(s)
I20260808 08:33:32.402803 11361 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:32.406483 11503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.404939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:43453)
0808 08:33:32.405372 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.405790 (+ 418us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":112,"threads_started":1}
W20260808 08:33:32.406924 11501 heartbeater.cc:644] Failed to heartbeat to 127.25.170.62:39679 (0 consecutive failures): Network error: Failed to ping master at 127.25.170.62:39679: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
I20260808 08:33:32.407460 11503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.407263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:38363)
0808 08:33:32.407363 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.407408 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 08:33:32.408087 11503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.407873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:45153)
0808 08:33:32.407997 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.408037 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 08:33:32.408288 11501 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:33:32.411209 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 11361
I20260808 08:33:33.082966 11505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:33.082537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:51591)
0808 08:33:33.082785 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:33.082870 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":77,"threads_started":1}
I20260808 08:33:33.227795 11506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:33.227423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:51853)
0808 08:33:33.227651 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:33.227703 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":69,"threads_started":1}
I20260808 08:33:33.409168 11507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:33.408788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:33089)
0808 08:33:33.409021 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:33.409074 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":79,"threads_started":1}
I20260808 08:33:33.478957 11508 raft_consensus.cc:482] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:33.479177 11508 raft_consensus.cc:504] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:33.480316 11508 leader_election.cc:288] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931), cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657)
Aug 08 08:33:33 dist-test-slave-zkpd krb5kdc[9795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178011, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.3@KRBTEST.COM
Aug 08 08:33:33 dist-test-slave-zkpd krb5kdc[9795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178011, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.2@KRBTEST.COM
I20260808 08:33:33.497947 11510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:33.480813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:38117 (local address 127.25.170.3:35657)
0808 08:33:33.481123 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:33.481155 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:33.481216 (+ 61us) server_negotiation.cc:407] Connection header received
0808 08:33:33.482146 (+ 930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:33.482156 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:33.482613 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:33.482949 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:33.484816 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:33.486403 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:33.488366 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:33.489110 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:33.489297 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:33.492784 (+ 3487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:33.492789 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:33.492803 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:33.492833 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:33.495109 (+ 2276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:33.495758 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:33.495763 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:33.495767 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:33.495927 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:33.496277 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:33.496281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:33.496282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:33.496820 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:33.496956 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:33.497506 (+ 550us) server_negotiation.cc:299] Negotiation successful
0808 08:33:33.497770 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":73,"threads_started":1}
I20260808 08:33:33.497927 11505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:33.480560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:37931 (local address 127.25.170.1:50705)
0808 08:33:33.480736 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:33.480752 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:33.480869 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:33.483060 (+ 2191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:33.483067 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:33.483701 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:33.484597 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:33.484619 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:33.486572 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:33.486576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:33.488220 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:33.488233 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:33.489243 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:33.489247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:33.489561 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:33.490400 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:33.490438 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:33.492889 (+ 2451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:33.495219 (+ 2330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:33.495224 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:33.495235 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:33.495581 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:33.495998 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:33.496002 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:33.496004 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:33.496160 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:33.496947 (+ 787us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:33.496953 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:33.497185 (+ 232us) client_negotiation.cc:769] Sending connection context
0808 08:33:33.497365 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 08:33:33.497714 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":391,"spinlock_wait_cycles":54400}
I20260808 08:33:33.498057 11509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:33.480560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:35657 (local address 127.25.170.1:38117)
0808 08:33:33.480980 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:33.480996 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:33.481104 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:33.483060 (+ 1956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:33.483067 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:33.483701 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:33.484597 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:33.484619 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:33.486572 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:33.486576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:33.488220 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:33.488233 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:33.489243 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:33.489247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:33.489561 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:33.490400 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:33.490426 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:33.492522 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:33.495268 (+ 2746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:33.495271 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:33.495273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:33.495587 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:33.496019 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:33.496022 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:33.496024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:33.496163 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:33.496949 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:33.496956 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:33.497185 (+ 229us) client_negotiation.cc:769] Sending connection context
0808 08:33:33.497333 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 08:33:33.497815 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":600,"spinlock_wait_cycles":23808,"thread_start_us":74,"threads_started":1}
I20260808 08:33:33.498313 11511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:33.480799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:50705 (local address 127.25.170.2:37931)
0808 08:33:33.481247 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:33.481269 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:33.481300 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:33:33.482146 (+ 846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:33.482156 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:33.482613 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:33.482950 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:33.484816 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:33.486403 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:33.488366 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:33.489110 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:33.489297 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:33.493078 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:33.493088 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:33.493104 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:33.493150 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:33.495109 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:33.495731 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:33.495736 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:33.495743 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:33.495867 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:33.496270 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:33.496274 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:33.496275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:33.496673 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:33.496768 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:33.497533 (+ 765us) server_negotiation.cc:299] Negotiation successful
0808 08:33:33.497814 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":135,"threads_started":1}
W20260808 08:33:33.500963 11089 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
W20260808 08:33:33.501140 11087 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
I20260808 08:33:33.501238 11087 leader_election.cc:302] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9307344866e44460974efd72b18e534a; no voters: cd987bc85f934d5487b9b290795760cb, fbd2878e91a147af956b939ef3b5404e
I20260808 08:33:33.501457 11508 raft_consensus.cc:2726] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:33:34.084197 11512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:34.083749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:45391)
0808 08:33:34.084046 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:34.084103 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":77,"threads_started":1}
I20260808 08:33:34.228891 11513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:34.228486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:60099)
0808 08:33:34.228735 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:34.228788 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":75,"threads_started":1}
I20260808 08:33:34.410154 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:34.409804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:44433)
0808 08:33:34.410026 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:34.410075 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":69,"threads_started":1}
I20260808 08:33:35.085445 11515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.084977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:48849)
0808 08:33:35.085256 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:35.085345 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":76,"threads_started":1}
I20260808 08:33:35.222407 11516 raft_consensus.cc:482] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:35.222532 11516 raft_consensus.cc:504] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:35.222994 11516 leader_election.cc:288] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931), cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657)
W20260808 08:33:35.223848 11087 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
W20260808 08:33:35.224000 11089 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
I20260808 08:33:35.224099 11089 leader_election.cc:302] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9307344866e44460974efd72b18e534a; no voters: cd987bc85f934d5487b9b290795760cb, fbd2878e91a147af956b939ef3b5404e
I20260808 08:33:35.224254 11516 raft_consensus.cc:2726] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:33:35.229929 11517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.229564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:52675)
0808 08:33:35.229797 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:35.229849 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":81,"threads_started":1}
I20260808 08:33:35.411345 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.410909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:55565)
0808 08:33:35.411174 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:35.411241 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":72,"threads_started":1}
I20260808 08:33:36.086838 11519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.086426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:60537)
0808 08:33:36.086676 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:36.086729 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":75,"threads_started":1}
I20260808 08:33:36.230966 11520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.230589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:55531)
0808 08:33:36.230821 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:36.230877 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":70,"threads_started":1}
I20260808 08:33:36.412477 11521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.412098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:40517)
0808 08:33:36.412332 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:36.412386 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":74,"threads_started":1}
I20260808 08:33:37.043262 11522 raft_consensus.cc:482] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:37.043438 11522 raft_consensus.cc:504] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:37.043946 11522 leader_election.cc:288] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931), cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657)
W20260808 08:33:37.044714 11089 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
W20260808 08:33:37.044807 11087 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
I20260808 08:33:37.044924 11087 leader_election.cc:302] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9307344866e44460974efd72b18e534a; no voters: cd987bc85f934d5487b9b290795760cb, fbd2878e91a147af956b939ef3b5404e
I20260808 08:33:37.045077 11522 raft_consensus.cc:2726] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:33:37.088235 11523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.087660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:60777)
0808 08:33:37.088053 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:37.088129 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":97,"threads_started":1}
I20260808 08:33:37.232159 11524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.231691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:54843)
0808 08:33:37.232011 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:37.232067 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":75,"threads_started":1}
I20260808 08:33:37.413545 11525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.413163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:55443)
0808 08:33:37.413407 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:37.413459 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":89,"threads_started":1}
I20260808 08:33:38.089397 11526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:38.088936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:41953)
0808 08:33:38.089216 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:38.089271 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":71,"threads_started":1}
I20260808 08:33:38.233287 11527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:38.232874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:36093)
0808 08:33:38.233141 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:38.233196 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":76,"threads_started":1}
I20260808 08:33:38.414569 11528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:38.414195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:37733)
0808 08:33:38.414431 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:38.414483 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":73,"threads_started":1}
I20260808 08:33:39.090592 11529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:39.090166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:57223)
0808 08:33:39.090446 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:39.090497 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":108,"threads_started":1}
I20260808 08:33:39.234711 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:39.234141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:48275)
0808 08:33:39.234481 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:39.234578 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":75,"threads_started":1}
I20260808 08:33:39.415674 11531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:39.415262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:48461)
0808 08:33:39.415540 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:39.415590 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":71,"threads_started":1}
I20260808 08:33:40.073434 11532 raft_consensus.cc:482] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:40.073592 11532 raft_consensus.cc:504] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:40.074024 11532 leader_election.cc:288] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931), cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657)
W20260808 08:33:40.074862 11087 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
W20260808 08:33:40.074970 11089 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
I20260808 08:33:40.075042 11089 leader_election.cc:302] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9307344866e44460974efd72b18e534a; no voters: cd987bc85f934d5487b9b290795760cb, fbd2878e91a147af956b939ef3b5404e
I20260808 08:33:40.075297 11532 raft_consensus.cc:2726] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:33:40.091774 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:40.091374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:58127)
0808 08:33:40.091627 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:40.091681 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":72,"threads_started":1}
I20260808 08:33:40.235976 11534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:40.235482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:36047)
0808 08:33:40.235751 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:40.235808 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":74,"threads_started":1}
I20260808 08:33:40.416864 11535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:40.416474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:37925)
0808 08:33:40.416725 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:40.416775 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":82,"threads_started":1}
I20260808 08:33:41.093083 11536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.092621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:53765)
0808 08:33:41.092889 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:41.092942 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":98,"threads_started":1}
I20260808 08:33:41.237149 11537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.236748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:41981)
0808 08:33:41.237007 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:41.237059 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":81,"threads_started":1}
I20260808 08:33:41.417990 11538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.417583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:56371)
0808 08:33:41.417827 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:41.417883 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":72,"threads_started":1}
I20260808 08:33:42.094501 11539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.094086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:58639)
0808 08:33:42.094349 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.094401 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":89,"threads_started":1}
I20260808 08:33:42.238400 11540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.237974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:52613)
0808 08:33:42.238239 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.238299 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":91,"threads_started":1}
I20260808 08:33:42.419152 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.418744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:59969)
0808 08:33:42.419009 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.419066 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":109,"threads_started":1}
I20260808 08:33:42.749622 11542 raft_consensus.cc:482] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:42.749758 11542 raft_consensus.cc:504] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:42.750216 11542 leader_election.cc:288] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931), cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657)
W20260808 08:33:42.751068 11087 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
W20260808 08:33:42.751178 11089 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
I20260808 08:33:42.751245 11089 leader_election.cc:302] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9307344866e44460974efd72b18e534a; no voters: cd987bc85f934d5487b9b290795760cb, fbd2878e91a147af956b939ef3b5404e
I20260808 08:33:42.751389 11542 raft_consensus.cc:2726] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:33:43.095621 11543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:43.095214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:44365)
0808 08:33:43.095474 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:43.095526 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":98,"threads_started":1}
I20260808 08:33:43.239511 11544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:43.239098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:40961)
0808 08:33:43.239354 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:43.239418 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":71,"threads_started":1}
I20260808 08:33:43.420361 11545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:43.419855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:37847)
0808 08:33:43.420207 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:43.420268 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":157,"threads_started":1}
I20260808 08:33:44.096848 11546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:44.096469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:56315)
0808 08:33:44.096705 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:44.096753 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":76,"threads_started":1}
I20260808 08:33:44.240840 11547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:44.240400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:53259)
0808 08:33:44.240660 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:44.240746 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":75,"threads_started":1}
I20260808 08:33:44.421547 11548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:44.421125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:47485)
0808 08:33:44.421403 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:44.421458 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":75,"threads_started":1}
I20260808 08:33:45.098084 11549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:45.097678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:49915)
0808 08:33:45.097934 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:45.097988 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":77,"threads_started":1}
I20260808 08:33:45.241981 11550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:45.241588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:50051)
0808 08:33:45.241835 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:45.241889 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":78,"threads_started":1}
I20260808 08:33:45.422735 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:45.422322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:59827)
0808 08:33:45.422588 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:45.422642 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":97,"threads_started":1}
I20260808 08:33:46.099202 11552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:46.098801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:44019)
0808 08:33:46.099049 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:46.099103 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":72,"threads_started":1}
I20260808 08:33:46.243173 11553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:46.242750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:60339)
0808 08:33:46.243018 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:46.243078 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":99,"threads_started":1}
I20260808 08:33:46.423854 11554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:46.423443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:37917)
0808 08:33:46.423701 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:46.423754 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":91,"threads_started":1}
I20260808 08:33:46.770804 11555 raft_consensus.cc:482] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:46.770943 11555 raft_consensus.cc:504] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbd2878e91a147af956b939ef3b5404e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 37931 } } peers { permanent_uuid: "cd987bc85f934d5487b9b290795760cb" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 35657 } } peers { permanent_uuid: "9307344866e44460974efd72b18e534a" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 45191 } }
I20260808 08:33:46.771382 11555 leader_election.cc:288] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931), cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657)
W20260808 08:33:46.772177 11087 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cd987bc85f934d5487b9b290795760cb (127.25.170.3:35657): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
W20260808 08:33:46.772289 11089 leader_election.cc:341] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbd2878e91a147af956b939ef3b5404e (127.25.170.2:37931): Not found: Tablet not found: 7843138e9ebe40ea9a980b8e01d0d7e1
I20260808 08:33:46.772439 11089 leader_election.cc:302] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9307344866e44460974efd72b18e534a; no voters: cd987bc85f934d5487b9b290795760cb, fbd2878e91a147af956b939ef3b5404e
I20260808 08:33:46.772632 11555 raft_consensus.cc:2726] T 7843138e9ebe40ea9a980b8e01d0d7e1 P 9307344866e44460974efd72b18e534a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:33:47.100754 11557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:47.100367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.1:52505)
0808 08:33:47.100607 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:47.100658 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":82,"threads_started":1}
I20260808 08:33:47.244490 11558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:47.244104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.2:33921)
0808 08:33:47.244353 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:47.244402 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
I20260808 08:33:47.415618 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 11028
I20260808 08:33:47.424444 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 11215
I20260808 08:33:47.425501 11559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:47.424762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39679 (local address 127.25.170.3:35751)
0808 08:33:47.425292 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:47.425370 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.62:39679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":72,"threads_started":1}
I20260808 08:33:47.432134 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 11361
2026-08-08T08:33:47Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59500 ms)
[----------] 30 tests from SecurityITest (240920 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:47 dist-test-slave-zkpd krb5kdc[11562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:47 dist-test-slave-zkpd krb5kdc[11562](info): set up 2 sockets
Aug 08 08:33:47 dist-test-slave-zkpd krb5kdc[11562](info): commencing operation
krb5kdc: starting...
W20260808 08:33:48.506358 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:33:48 dist-test-slave-zkpd krb5kdc[11562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:33:48.626956 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:41631
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:37529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:41631
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:48.739423 11577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:48.739672 11577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:48.739745 11577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:48.743731 11577 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:48.743779 11577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:48.743798 11577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:48.743813 11577 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:48.743826 11577 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:48.749079 11577 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:37529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:41631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:41631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:48.750152 11577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:48.751190 11577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:48.760067 11586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:48.760067 11583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:48.760139 11584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:48.760346 11577 server_base.cc:1034] running on GCE node
I20260808 08:33:48.761039 11577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:48.762115 11577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:48.763275 11577 hybrid_clock.cc:648] HybridClock initialized: now 1786178028763258 us; error 36 us; skew 500 ppm
Aug 08 08:33:48 dist-test-slave-zkpd krb5kdc[11562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178028, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:48.766108 11577 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:33:48.766961 11577 webserver.cc:460] Webserver started at http://127.25.170.62:36727/ using document root <none> and password file <none>
I20260808 08:33:48.767529 11577 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:48.767621 11577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:48.767868 11577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:48.769994 11577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "2cf8cf672e0c440a9d7d805503d24f39"
format_stamp: "Formatted at 2026-08-08 08:33:48 on dist-test-slave-zkpd"
server_key: "6bf07e39a5475f171860f21d9ab265be"
server_key_iv: "cc65a4bd73d9b03dd316681cdc8a357c"
server_key_version: "encryptionkey@0"
I20260808 08:33:48.770577 11577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "2cf8cf672e0c440a9d7d805503d24f39"
format_stamp: "Formatted at 2026-08-08 08:33:48 on dist-test-slave-zkpd"
server_key: "6bf07e39a5475f171860f21d9ab265be"
server_key_iv: "cc65a4bd73d9b03dd316681cdc8a357c"
server_key_version: "encryptionkey@0"
I20260808 08:33:48.774453 11577 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 08:33:48.777015 11595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:48.778259 11577 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:33:48.778398 11577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "2cf8cf672e0c440a9d7d805503d24f39"
format_stamp: "Formatted at 2026-08-08 08:33:48 on dist-test-slave-zkpd"
server_key: "6bf07e39a5475f171860f21d9ab265be"
server_key_iv: "cc65a4bd73d9b03dd316681cdc8a357c"
server_key_version: "encryptionkey@0"
I20260808 08:33:48.778513 11577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:48.807433 11577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:48.810520 11577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:48.810730 11577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:48.818101 11577 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:41631
I20260808 08:33:48.818125 11651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:41631 every 8 connection(s)
I20260808 08:33:48.819051 11577 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:48.821893 11652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:48.823647 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 11577
I20260808 08:33:48.823756 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:33:48.824082 26280 external_mini_cluster.cc:1428] Setting key 41da54138f6d753d324ad837b0984f94
I20260808 08:33:48.828280 11652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39: Bootstrap starting.
I20260808 08:33:48.830464 11652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:48.831322 11652 log.cc:824] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:33:48 dist-test-slave-zkpd krb5kdc[11562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:48.833645 11652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39: No bootstrap required, opened a new log
I20260808 08:33:48.837421 11652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf8cf672e0c440a9d7d805503d24f39" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41631 } }
I20260808 08:33:48.837692 11652 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:48.837775 11652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cf8cf672e0c440a9d7d805503d24f39, State: Initialized, Role: FOLLOWER
I20260808 08:33:48.838243 11652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf8cf672e0c440a9d7d805503d24f39" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41631 } }
I20260808 08:33:48.838366 11655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:48.825519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47688 (local address 127.25.170.62:41631)
0808 08:33:48.825973 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:48.825988 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:48.826023 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:33:48.826656 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:48.826673 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:48.826990 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:48.827314 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:48.828171 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:48.829161 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:48.830049 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:48.830517 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:48.830692 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:48.833740 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:48.833749 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:48.833772 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:48.833800 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:48.835478 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:48.835948 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:48.835953 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:48.835957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:48.836064 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:48.836358 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:48.836361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:48.836363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:48.836732 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:48.836953 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:48.837204 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 08:33:48.837508 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":149,"threads_started":1}
I20260808 08:33:48.838367 11652 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:48.838490 11652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:48.838577 11652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:48.839478 11652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf8cf672e0c440a9d7d805503d24f39" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41631 } }
I20260808 08:33:48.839825 11652 leader_election.cc:302] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cf8cf672e0c440a9d7d805503d24f39; no voters:
I20260808 08:33:48.840209 11652 leader_election.cc:288] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:48.840296 11657 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:48.840502 11657 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [term 1 LEADER]: Becoming Leader. State: Replica: 2cf8cf672e0c440a9d7d805503d24f39, State: Running, Role: LEADER
I20260808 08:33:48.840869 11657 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf8cf672e0c440a9d7d805503d24f39" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41631 } }
I20260808 08:33:48.841480 11652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:48.842057 11657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2cf8cf672e0c440a9d7d805503d24f39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf8cf672e0c440a9d7d805503d24f39" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41631 } } }
I20260808 08:33:48.842185 11657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:48.842432 11657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cf8cf672e0c440a9d7d805503d24f39. Latest consensus state: current_term: 1 leader_uuid: "2cf8cf672e0c440a9d7d805503d24f39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf8cf672e0c440a9d7d805503d24f39" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 41631 } } }
I20260808 08:33:48.842598 11663 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:48.842730 11657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:48.846072 11663 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:48.852092 11663 catalog_manager.cc:1347] Generated new cluster ID: 495f7870925943aabd01dedc92a7fa11
I20260808 08:33:48.852165 11663 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:48.861766 11663 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:48.862932 11663 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:48.871838 11663 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39: Generated new TSK 0
I20260808 08:33:48.872570 11663 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:33:48.903208 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41631
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:37529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:49.017478 11680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:49.017715 11680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:49.017757 11680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:49.021803 11680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:49.021857 11680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:49.021912 11680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:33:49.026968 11680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:37529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:49.028055 11680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:49.029131 11680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:49.038725 11687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:49.038725 11686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:49.038909 11680 server_base.cc:1034] running on GCE node
W20260808 08:33:49.038766 11689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:49.039522 11680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:49.040197 11680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:49.041424 11680 hybrid_clock.cc:648] HybridClock initialized: now 1786178029041408 us; error 25 us; skew 500 ppm
Aug 08 08:33:49 dist-test-slave-zkpd krb5kdc[11562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178029, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:49.044397 11680 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:33:49.045267 11680 webserver.cc:460] Webserver started at http://127.25.170.1:36863/ using document root <none> and password file <none>
I20260808 08:33:49.045806 11680 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:49.045873 11680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:49.046095 11680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:49.048123 11680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "44b08f64afde4f0791a69b97e1c74126"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-zkpd"
server_key: "4801c6698c842656efa54a874a318f95"
server_key_iv: "523f1b3ebc617ec59f9f6ee65c190593"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.048691 11680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "44b08f64afde4f0791a69b97e1c74126"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-zkpd"
server_key: "4801c6698c842656efa54a874a318f95"
server_key_iv: "523f1b3ebc617ec59f9f6ee65c190593"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.052357 11680 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:49.054657 11696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.055872 11680 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:49.056069 11680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "44b08f64afde4f0791a69b97e1c74126"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-zkpd"
server_key: "4801c6698c842656efa54a874a318f95"
server_key_iv: "523f1b3ebc617ec59f9f6ee65c190593"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.056195 11680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:49.069346 11680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:49.072121 11680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:49.072319 11680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:49.072890 11680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:49.073688 11680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:49.073772 11680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.073848 11680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:49.073894 11680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.083163 11680 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:36933
I20260808 08:33:49.083194 11819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:36933 every 8 connection(s)
I20260808 08:33:49.084059 11680 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:49.089936 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 11680
I20260808 08:33:49.090075 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:49.090371 26280 external_mini_cluster.cc:1428] Setting key 622bec43a6ae0c7cc58f60ad601ba5bf
Aug 08 08:33:49 dist-test-slave-zkpd krb5kdc[11562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178029, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:49.098249 11655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.085793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:60493 (local address 127.25.170.62:41631)
0808 08:33:49.085943 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.085948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.086810 (+ 862us) server_negotiation.cc:407] Connection header received
0808 08:33:49.088362 (+ 1552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.088366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.088413 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.088488 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:49.089592 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.090238 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.091435 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.091682 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.091797 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.094487 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:49.094490 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:49.094492 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:49.094514 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:49.096112 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:49.096710 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:49.096716 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:49.096718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:49.096805 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:49.097146 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:49.097151 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:49.097152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:49.097342 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:49.097455 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.097947 (+ 492us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.098074 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:33:49.099164 11823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.086204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41631 (local address 127.25.170.1:60493)
0808 08:33:49.086626 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:49.086667 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:49.088165 (+ 1498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:49.088645 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:49.088652 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:49.088987 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:49.089464 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.089479 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.090365 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.090370 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.091295 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.091306 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.091848 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.091853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.092060 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.092627 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:49.092642 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:49.094309 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:49.096238 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:49.096243 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:49.096258 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:49.096608 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:49.096898 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:49.096901 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:49.096903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:49.097048 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:49.097450 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:49.097456 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:49.097705 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 08:33:49.097905 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 08:33:49.098222 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":118,"threads_started":1}
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
I20260808 08:33:49.100580 11821 heartbeater.cc:347] Connected to a master server at 127.25.170.62:41631
I20260808 08:33:49.100850 11821 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:49.101390 11821 heartbeater.cc:511] Master 127.25.170.62:41631 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:33:49.103363 11613 ts_manager.cc:194] Registered new tserver with Master: 44b08f64afde4f0791a69b97e1c74126 (127.25.170.1:36933)
I20260808 08:33:49.105098 11613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:60493
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:33:49.120608 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41631
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:37529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:49.234625 11826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:49.234905 11826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:49.234979 11826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:49.239005 11826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:49.239089 11826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:49.239174 11826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:33:49.244436 11826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:37529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:49.245497 11826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:49.246484 11826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:49.259652 11832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:49.259653 11831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:49.260180 11834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:49.260455 11826 server_base.cc:1034] running on GCE node
I20260808 08:33:49.260883 11826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:49.261507 11826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:49.262696 11826 hybrid_clock.cc:648] HybridClock initialized: now 1786178029262657 us; error 55 us; skew 500 ppm
Aug 08 08:33:49 dist-test-slave-zkpd krb5kdc[11562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178029, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:49.265662 11826 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:33:49.266607 11826 webserver.cc:460] Webserver started at http://127.25.170.2:44717/ using document root <none> and password file <none>
I20260808 08:33:49.267153 11826 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:49.267241 11826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:49.267457 11826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:49.269742 11826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "235a3d8efb3e4897a3738300ff941be6"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-zkpd"
server_key: "75ed03a6d7525ce9eebc0ff123ead08e"
server_key_iv: "5333555747f3ab71fe8b2ace819b8bd1"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.270329 11826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "235a3d8efb3e4897a3738300ff941be6"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-zkpd"
server_key: "75ed03a6d7525ce9eebc0ff123ead08e"
server_key_iv: "5333555747f3ab71fe8b2ace819b8bd1"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.274453 11826 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260808 08:33:49.276932 11842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.278201 11826 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:49.278329 11826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "235a3d8efb3e4897a3738300ff941be6"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-zkpd"
server_key: "75ed03a6d7525ce9eebc0ff123ead08e"
server_key_iv: "5333555747f3ab71fe8b2ace819b8bd1"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.278436 11826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:49.309293 11826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:49.312477 11826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:49.312671 11826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:49.313323 11826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:49.314165 11826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:49.314237 11826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.314313 11826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:49.314365 11826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.325261 11826 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:34225
I20260808 08:33:49.325358 11967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:34225 every 8 connection(s)
I20260808 08:33:49.326184 11826 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:49.327080 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 11826
I20260808 08:33:49.327237 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:49.327620 26280 external_mini_cluster.cc:1428] Setting key 5fc7298cfd7876c3c49625db09c0faa4
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
Aug 08 08:33:49 dist-test-slave-zkpd krb5kdc[11562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178029, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:49.347236 11655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.328110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:41181 (local address 127.25.170.62:41631)
0808 08:33:49.328248 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.328252 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.329351 (+ 1099us) server_negotiation.cc:407] Connection header received
0808 08:33:49.331459 (+ 2108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.331466 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.331532 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.331629 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:49.333354 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.334305 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.336274 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.336657 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.336786 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.342565 (+ 5779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:49.342573 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:49.342579 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:49.342616 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:49.344465 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:49.345176 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:49.345183 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:49.345188 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:49.345288 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:49.345742 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:49.345749 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:49.345754 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:49.346028 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:49.346149 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.346834 (+ 685us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.346986 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:33:49.348297 11970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.328597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41631 (local address 127.25.170.2:41181)
0808 08:33:49.329173 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:49.329234 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:49.331143 (+ 1909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:49.331841 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:49.331852 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:49.332422 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:49.333158 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.333181 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.334452 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.334457 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.336121 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.336136 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.336837 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.336842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.337087 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.337938 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:49.337965 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:49.342307 (+ 4342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:49.344600 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:49.344609 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:49.344628 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:49.345029 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:49.345404 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:49.345410 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:49.345413 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:49.345608 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:49.346155 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:49.346164 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:49.346512 (+ 348us) client_negotiation.cc:769] Sending connection context
0808 08:33:49.346729 (+ 217us) client_negotiation.cc:240] Negotiation successful
0808 08:33:49.347108 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":168,"threads_started":1}
I20260808 08:33:49.349695 11968 heartbeater.cc:347] Connected to a master server at 127.25.170.62:41631
I20260808 08:33:49.349973 11968 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:49.350605 11968 heartbeater.cc:511] Master 127.25.170.62:41631 requested a full tablet report, sending...
I20260808 08:33:49.351774 11613 ts_manager.cc:194] Registered new tserver with Master: 235a3d8efb3e4897a3738300ff941be6 (127.25.170.2:34225)
I20260808 08:33:49.352361 11613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:41181
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:33:49.358184 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41631
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:37529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:49.476492 11973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:49.476729 11973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:49.476773 11973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:49.480741 11973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:49.480791 11973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:49.480851 11973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:33:49.486289 11973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:37529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:41631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:49.487239 11973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:49.488224 11973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:49.497310 11978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:49.497537 11973 server_base.cc:1034] running on GCE node
W20260808 08:33:49.497319 11979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:49.497346 11981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:49.498121 11973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:49.498682 11973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:49.499840 11973 hybrid_clock.cc:648] HybridClock initialized: now 1786178029499811 us; error 42 us; skew 500 ppm
Aug 08 08:33:49 dist-test-slave-zkpd krb5kdc[11562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178029, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:49.502586 11973 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:33:49.503350 11973 webserver.cc:460] Webserver started at http://127.25.170.3:46757/ using document root <none> and password file <none>
I20260808 08:33:49.503849 11973 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:49.503978 11973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:49.504209 11973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:49.506158 11973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "b9d27c8642274c1a9439b79d7a749a0e"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-zkpd"
server_key: "ea0086cad75c80f4be9701dd86bad6ea"
server_key_iv: "de07fc90c59fbf9f475e8a78a4bf60eb"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.506695 11973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "b9d27c8642274c1a9439b79d7a749a0e"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-zkpd"
server_key: "ea0086cad75c80f4be9701dd86bad6ea"
server_key_iv: "de07fc90c59fbf9f475e8a78a4bf60eb"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.510154 11973 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 08:33:49.512457 11988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.513595 11973 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:49.513727 11973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "b9d27c8642274c1a9439b79d7a749a0e"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-zkpd"
server_key: "ea0086cad75c80f4be9701dd86bad6ea"
server_key_iv: "de07fc90c59fbf9f475e8a78a4bf60eb"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.513854 11973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:49.529724 11973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:49.532538 11973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:49.532732 11973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:49.533311 11973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:49.534123 11973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:49.534170 11973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.534237 11973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:49.534274 11973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.543737 11973 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:34931
I20260808 08:33:49.543808 12109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:34931 every 8 connection(s)
I20260808 08:33:49.544713 11973 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
Aug 08 08:33:49 dist-test-slave-zkpd krb5kdc[11562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178029, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:49.554982 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 11973
I20260808 08:33:49.555138 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:49.555430 26280 external_mini_cluster.cc:1428] Setting key c02aace0fd76aade94bd2bf7ac90fcc0
I20260808 08:33:49.557917 11655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.546488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:41853 (local address 127.25.170.62:41631)
0808 08:33:49.546623 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.546627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.547427 (+ 800us) server_negotiation.cc:407] Connection header received
0808 08:33:49.548744 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.548747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.548795 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.548870 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:49.549961 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.550480 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.551542 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.551744 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.551824 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.554160 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:49.554164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:49.554166 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:49.554190 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:49.555694 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:49.556275 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:49.556320 (+ 45us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:49.556321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:49.556419 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:49.556789 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:49.556792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:49.556794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:49.557045 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:49.557151 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.557685 (+ 534us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.557797 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:33:49.558657 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.546847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:41631 (local address 127.25.170.3:41853)
0808 08:33:49.547269 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:49.547309 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:49.548551 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:49.549028 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:49.549034 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:49.549380 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:49.549831 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.549844 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.550584 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.550587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.551438 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.551447 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.551871 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.551873 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.552074 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.552574 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:49.552589 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:49.553987 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:49.555825 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:49.555831 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:49.555845 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:49.556167 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:49.556536 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:49.556539 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:49.556541 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:49.556681 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:49.557150 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:49.557157 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:49.557382 (+ 225us) client_negotiation.cc:769] Sending connection context
0808 08:33:49.557606 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 08:33:49.557851 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":117,"threads_started":1}
I20260808 08:33:49.559784 12110 heartbeater.cc:347] Connected to a master server at 127.25.170.62:41631
I20260808 08:33:49.560045 12110 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:49.560472 12110 heartbeater.cc:511] Master 127.25.170.62:41631 requested a full tablet report, sending...
I20260808 08:33:49.561378 11613 ts_manager.cc:194] Registered new tserver with Master: b9d27c8642274c1a9439b79d7a749a0e (127.25.170.3:34931)
I20260808 08:33:49.561936 11613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:41853
I20260808 08:33:49.569307 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:33:49.578369 11655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.571287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47690 (local address 127.25.170.62:41631)
0808 08:33:49.571459 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.571465 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.571605 (+ 140us) server_negotiation.cc:407] Connection header received
0808 08:33:49.571699 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.571702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.571742 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.571802 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:49.572522 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.573011 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.573826 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.574029 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.574101 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.575336 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:49.575339 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:49.575341 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:49.575369 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:49.576673 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:49.577108 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:49.577113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:49.577115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:49.577195 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:49.577474 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:49.577481 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:49.577482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:49.577689 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:49.577825 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.578088 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.578200 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:33:49.581034 11613 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47690:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:49.584455 11613 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:49.598979 12127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.593735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49306 (local address 127.25.170.2:34225)
0808 08:33:49.594171 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.594182 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.594271 (+ 89us) server_negotiation.cc:407] Connection header received
0808 08:33:49.594409 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.594414 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.594567 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.594722 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:49.594976 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.595938 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.597766 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.598419 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.598522 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.598668 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.598733 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.598831 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":198,"threads_started":1}
I20260808 08:33:49.598968 12123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.592462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:36933 (local address 127.0.0.1:42752)
0808 08:33:49.592797 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:49.592850 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:49.593109 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:49.593903 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:49.593912 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:49.593944 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:49.594069 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.594076 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.595559 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.595562 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.597106 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.597121 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.598282 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.598286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.598474 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.598531 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 08:33:49.598640 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 08:33:49.598767 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":49,"thread_start_us":76,"threads_started":1}
I20260808 08:33:49.598978 12124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.592521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:34225 (local address 127.0.0.1:49306)
0808 08:33:49.594190 (+ 1669us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:49.594206 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:49.594303 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:49.594708 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:49.594710 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:49.594729 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:49.594856 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.594863 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.596101 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.596104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.597621 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.597632 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.598535 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.598538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.598621 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.598645 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:33:49.598704 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 08:33:49.598773 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1607,"mutex_wait_us":22,"spinlock_wait_cycles":1920,"thread_start_us":109,"threads_started":1}
I20260808 08:33:49.599563 12125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.592596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42752 (local address 127.25.170.1:36933)
0808 08:33:49.593362 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.593369 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.593400 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:33:49.593465 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.593470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.593695 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.593911 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:49.594223 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.595402 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.597246 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.598145 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.598254 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.598412 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.599310 (+ 898us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.599416 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":72,"threads_started":1}
I20260808 08:33:49.599938 12126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.593214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:34931 (local address 127.0.0.1:42028)
0808 08:33:49.594660 (+ 1446us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:49.594673 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:49.594767 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:49.595407 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:49.595410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:49.595430 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:49.595518 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.595523 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.597245 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.597248 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.598436 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.598446 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.599552 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.599556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.599637 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.599657 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 08:33:49.599725 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 08:33:49.599789 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1388,"mutex_wait_us":4,"spinlock_wait_cycles":2048,"thread_start_us":119,"threads_started":1}
I20260808 08:33:49.600723 12128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.594215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42028 (local address 127.25.170.3:34931)
0808 08:33:49.595006 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.595016 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.595036 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:33:49.595103 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.595108 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.595268 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.595405 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:49.595632 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.597009 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.598578 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.599427 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.599552 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.600445 (+ 893us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.600500 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.600587 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":138,"threads_started":1}
I20260808 08:33:49.602289 11749 tablet_service.cc:1467] Processing CreateTablet for tablet fbc18ec14b65400b93e265f5ad370598 (DEFAULT_TABLE table=test-table [id=7f86e58f7d224242af59304edcfef175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:49.603385 11749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc18ec14b65400b93e265f5ad370598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:49.603137 12040 tablet_service.cc:1467] Processing CreateTablet for tablet fbc18ec14b65400b93e265f5ad370598 (DEFAULT_TABLE table=test-table [id=7f86e58f7d224242af59304edcfef175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:49.604063 12040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc18ec14b65400b93e265f5ad370598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:49.604739 11899 tablet_service.cc:1467] Processing CreateTablet for tablet fbc18ec14b65400b93e265f5ad370598 (DEFAULT_TABLE table=test-table [id=7f86e58f7d224242af59304edcfef175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:49.605724 11899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc18ec14b65400b93e265f5ad370598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:49.610121 12129 tablet_bootstrap.cc:492] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: Bootstrap starting.
I20260808 08:33:49.612254 12130 tablet_bootstrap.cc:492] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126: Bootstrap starting.
I20260808 08:33:49.612390 12129 tablet_bootstrap.cc:654] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:49.612462 12131 tablet_bootstrap.cc:492] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: Bootstrap starting.
I20260808 08:33:49.613791 12129 log.cc:824] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:49.614184 12130 tablet_bootstrap.cc:654] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:49.615041 12130 log.cc:824] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:49.615072 12131 tablet_bootstrap.cc:654] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:49.615881 12129 tablet_bootstrap.cc:492] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: No bootstrap required, opened a new log
I20260808 08:33:49.615881 12131 log.cc:824] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:49.616101 12129 ts_tablet_manager.cc:1397] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:33:49.617121 12130 tablet_bootstrap.cc:492] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126: No bootstrap required, opened a new log
I20260808 08:33:49.617311 12130 ts_tablet_manager.cc:1397] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 08:33:49.617991 12131 tablet_bootstrap.cc:492] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: No bootstrap required, opened a new log
I20260808 08:33:49.618178 12131 ts_tablet_manager.cc:1397] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:33:49.620185 12129 raft_consensus.cc:348] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 } } peers { permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 } } peers { permanent_uuid: "b9d27c8642274c1a9439b79d7a749a0e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34931 } }
I20260808 08:33:49.620477 12129 raft_consensus.cc:374] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:49.620570 12129 raft_consensus.cc:729] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d27c8642274c1a9439b79d7a749a0e, State: Initialized, Role: FOLLOWER
I20260808 08:33:49.621042 12129 consensus_queue.cc:260] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 } } peers { permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 } } peers { permanent_uuid: "b9d27c8642274c1a9439b79d7a749a0e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34931 } }
I20260808 08:33:49.621275 12131 raft_consensus.cc:348] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 } } peers { permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 } } peers { permanent_uuid: "b9d27c8642274c1a9439b79d7a749a0e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34931 } }
I20260808 08:33:49.621619 12131 raft_consensus.cc:374] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:49.621718 12131 raft_consensus.cc:729] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 235a3d8efb3e4897a3738300ff941be6, State: Initialized, Role: FOLLOWER
I20260808 08:33:49.621637 12130 raft_consensus.cc:348] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 } } peers { permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 } } peers { permanent_uuid: "b9d27c8642274c1a9439b79d7a749a0e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34931 } }
I20260808 08:33:49.621917 12130 raft_consensus.cc:374] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:49.622010 12130 raft_consensus.cc:729] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b08f64afde4f0791a69b97e1c74126, State: Initialized, Role: FOLLOWER
I20260808 08:33:49.622180 12129 ts_tablet_manager.cc:1428] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:33:49.622284 12131 consensus_queue.cc:260] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 } } peers { permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 } } peers { permanent_uuid: "b9d27c8642274c1a9439b79d7a749a0e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34931 } }
I20260808 08:33:49.622437 12130 consensus_queue.cc:260] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 } } peers { permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 } } peers { permanent_uuid: "b9d27c8642274c1a9439b79d7a749a0e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34931 } }
I20260808 08:33:49.622571 12110 heartbeater.cc:503] Master 127.25.170.62:41631 was elected leader, sending a full tablet report...
I20260808 08:33:49.623112 11821 heartbeater.cc:503] Master 127.25.170.62:41631 was elected leader, sending a full tablet report...
I20260808 08:33:49.623267 12131 ts_tablet_manager.cc:1428] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 08:33:49.623380 12130 ts_tablet_manager.cc:1428] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:33:49.623577 11968 heartbeater.cc:503] Master 127.25.170.62:41631 was elected leader, sending a full tablet report...
I20260808 08:33:49.729553 12136 raft_consensus.cc:482] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:49.729816 12136 raft_consensus.cc:504] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 } } peers { permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 } } peers { permanent_uuid: "b9d27c8642274c1a9439b79d7a749a0e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34931 } }
I20260808 08:33:49.731055 12136 leader_election.cc:288] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44b08f64afde4f0791a69b97e1c74126 (127.25.170.1:36933), 235a3d8efb3e4897a3738300ff941be6 (127.25.170.2:34225)
I20260808 08:33:49.736292 12127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.731525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:49353 (local address 127.25.170.2:34225)
0808 08:33:49.731666 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.731670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.731797 (+ 127us) server_negotiation.cc:407] Connection header received
0808 08:33:49.731989 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.731991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.732039 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.732099 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:49.732398 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.733124 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.734954 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.735571 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.735708 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.735761 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.736086 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.736161 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:33:49.736292 12125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.731494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:44885 (local address 127.25.170.1:36933)
0808 08:33:49.731707 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.731712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.731730 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:33:49.731790 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.731793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.731857 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.731976 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:49.732244 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.733060 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.734954 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.735604 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.735709 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.735761 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.736086 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.736161 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260808 08:33:49.736342 12112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.731245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:36933 (local address 127.25.170.3:44885)
0808 08:33:49.731428 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:49.731444 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:49.731536 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:49.731981 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:49.731984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:49.732000 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:49.732136 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.732142 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.733246 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.733250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.734819 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.734832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.735725 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.735729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.735870 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.735976 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 08:33:49.736055 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 08:33:49.736171 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":235}
I20260808 08:33:49.736351 12139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.731351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:34225 (local address 127.25.170.3:49353)
0808 08:33:49.731690 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:49.731703 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:49.731815 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:49.732119 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:49.732121 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:49.732136 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:49.732282 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.732288 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.733246 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.733250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.734819 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.734832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.735748 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.735752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.735911 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.735970 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 08:33:49.736055 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 08:33:49.736171 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":192,"thread_start_us":121,"threads_started":1}
I20260808 08:33:49.737042 11771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbc18ec14b65400b93e265f5ad370598" candidate_uuid: "b9d27c8642274c1a9439b79d7a749a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b08f64afde4f0791a69b97e1c74126" is_pre_election: true
I20260808 08:33:49.737138 11919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbc18ec14b65400b93e265f5ad370598" candidate_uuid: "b9d27c8642274c1a9439b79d7a749a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "235a3d8efb3e4897a3738300ff941be6" is_pre_election: true
I20260808 08:33:49.737386 11771 raft_consensus.cc:2454] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d27c8642274c1a9439b79d7a749a0e in term 0.
I20260808 08:33:49.737447 11919 raft_consensus.cc:2454] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d27c8642274c1a9439b79d7a749a0e in term 0.
I20260808 08:33:49.737881 11990 leader_election.cc:302] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44b08f64afde4f0791a69b97e1c74126, b9d27c8642274c1a9439b79d7a749a0e; no voters:
I20260808 08:33:49.738164 12136 raft_consensus.cc:2781] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:49.738255 12136 raft_consensus.cc:482] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:49.738299 12136 raft_consensus.cc:3037] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:49.739323 12136 raft_consensus.cc:504] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 } } peers { permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 } } peers { permanent_uuid: "b9d27c8642274c1a9439b79d7a749a0e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34931 } }
I20260808 08:33:49.739663 12136 leader_election.cc:288] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [CANDIDATE]: Term 1 election: Requested vote from peers 44b08f64afde4f0791a69b97e1c74126 (127.25.170.1:36933), 235a3d8efb3e4897a3738300ff941be6 (127.25.170.2:34225)
I20260808 08:33:49.740006 11771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbc18ec14b65400b93e265f5ad370598" candidate_uuid: "b9d27c8642274c1a9439b79d7a749a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b08f64afde4f0791a69b97e1c74126"
I20260808 08:33:49.740139 11919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbc18ec14b65400b93e265f5ad370598" candidate_uuid: "b9d27c8642274c1a9439b79d7a749a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "235a3d8efb3e4897a3738300ff941be6"
I20260808 08:33:49.740126 11771 raft_consensus.cc:3037] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:49.740286 11919 raft_consensus.cc:3037] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:49.741598 11771 raft_consensus.cc:2454] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d27c8642274c1a9439b79d7a749a0e in term 1.
I20260808 08:33:49.741740 11919 raft_consensus.cc:2454] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d27c8642274c1a9439b79d7a749a0e in term 1.
I20260808 08:33:49.741961 11990 leader_election.cc:302] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44b08f64afde4f0791a69b97e1c74126, b9d27c8642274c1a9439b79d7a749a0e; no voters:
I20260808 08:33:49.742151 12136 raft_consensus.cc:2781] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:49.742489 12136 raft_consensus.cc:686] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 1 LEADER]: Becoming Leader. State: Replica: b9d27c8642274c1a9439b79d7a749a0e, State: Running, Role: LEADER
I20260808 08:33:49.742848 12136 consensus_queue.cc:237] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 } } peers { permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 } } peers { permanent_uuid: "b9d27c8642274c1a9439b79d7a749a0e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34931 } }
I20260808 08:33:49.746222 11611 catalog_manager.cc:5495] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d27c8642274c1a9439b79d7a749a0e (127.25.170.3). New cstate: current_term: 1 leader_uuid: "b9d27c8642274c1a9439b79d7a749a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9d27c8642274c1a9439b79d7a749a0e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34931 } health_report { overall_health: HEALTHY } } }
I20260808 08:33:49.785915 12128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.782513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42032 (local address 127.25.170.3:34931)
0808 08:33:49.782660 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.782664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.782678 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:33:49.782816 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.782819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.782880 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.782969 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:49.783222 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.783749 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.784604 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.784808 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.784888 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.785147 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:49.785550 (+ 403us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:49.785640 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.785693 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.785740 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:33:49.791558 11919 raft_consensus.cc:1261] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6 [term 1 FOLLOWER]: Refusing update from remote peer b9d27c8642274c1a9439b79d7a749a0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:49.791563 11771 raft_consensus.cc:1261] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126 [term 1 FOLLOWER]: Refusing update from remote peer b9d27c8642274c1a9439b79d7a749a0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:49.792325 12140 consensus_queue.cc:1035] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44b08f64afde4f0791a69b97e1c74126" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:49.792539 12136 consensus_queue.cc:1035] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "235a3d8efb3e4897a3738300ff941be6" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 34225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:33:49.795672 12111 tablet.cc:2369] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:49.800110 12145 mvcc.cc:205] Tried to move back new op lower bound from 7316185210019385344 to 7316185209829683200. Current Snapshot: MvccSnapshot[applied={T|T < 7316185210019385344}]
I20260808 08:33:49.801126 12146 mvcc.cc:205] Tried to move back new op lower bound from 7316185210019385344 to 7316185209829683200. Current Snapshot: MvccSnapshot[applied={T|T < 7316185210019385344}]
I20260808 08:33:49.807088 11611 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:49.807266 11611 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:49.809795 11611 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2cf8cf672e0c440a9d7d805503d24f39: Sending DeleteTablet for 3 replicas of tablet fbc18ec14b65400b93e265f5ad370598
I20260808 08:33:49.810489 11899 tablet_service.cc:1514] Processing DeleteTablet for tablet fbc18ec14b65400b93e265f5ad370598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:49 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:49306
I20260808 08:33:49.810499 11749 tablet_service.cc:1514] Processing DeleteTablet for tablet fbc18ec14b65400b93e265f5ad370598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:49 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:42752
I20260808 08:33:49.810498 12040 tablet_service.cc:1514] Processing DeleteTablet for tablet fbc18ec14b65400b93e265f5ad370598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:49 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:42028
I20260808 08:33:49.810952 12155 tablet_replica.cc:330] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: stopping tablet replica
I20260808 08:33:49.811091 12156 tablet_replica.cc:330] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126: stopping tablet replica
I20260808 08:33:49.811301 12155 raft_consensus.cc:2229] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:49.811345 12156 raft_consensus.cc:2229] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:49.811614 12156 raft_consensus.cc:2258] T fbc18ec14b65400b93e265f5ad370598 P 44b08f64afde4f0791a69b97e1c74126 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:49.811614 12155 raft_consensus.cc:2258] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:49.811681 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 11680
I20260808 08:33:49.813202 12157 tablet_replica.cc:330] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: stopping tablet replica
I20260808 08:33:49.813450 12157 raft_consensus.cc:2229] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:49.813651 12155 ts_tablet_manager.cc:1905] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:49.813798 12157 raft_consensus.cc:2258] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:49.815068 12157 ts_tablet_manager.cc:1905] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:49.816771 12155 ts_tablet_manager.cc:1918] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:49.816927 12155 log.cc:1196] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/fbc18ec14b65400b93e265f5ad370598
I20260808 08:33:49.817291 12155 ts_tablet_manager.cc:1939] T fbc18ec14b65400b93e265f5ad370598 P 235a3d8efb3e4897a3738300ff941be6: Deleting consensus metadata
I20260808 08:33:49.818111 12157 ts_tablet_manager.cc:1918] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:49.818234 12157 log.cc:1196] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/fbc18ec14b65400b93e265f5ad370598
I20260808 08:33:49.818723 12157 ts_tablet_manager.cc:1939] T fbc18ec14b65400b93e265f5ad370598 P b9d27c8642274c1a9439b79d7a749a0e: Deleting consensus metadata
I20260808 08:33:49.819669 11600 catalog_manager.cc:4841] TS b9d27c8642274c1a9439b79d7a749a0e (127.25.170.3:34931): tablet fbc18ec14b65400b93e265f5ad370598 (table test-table [id=7f86e58f7d224242af59304edcfef175]) successfully deleted
I20260808 08:33:49.820000 11598 catalog_manager.cc:4841] TS 235a3d8efb3e4897a3738300ff941be6 (127.25.170.2:34225): tablet fbc18ec14b65400b93e265f5ad370598 (table test-table [id=7f86e58f7d224242af59304edcfef175]) successfully deleted
W20260808 08:33:49.825770 11596 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:36933 (error 108)
I20260808 08:33:49.826093 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 11826
I20260808 08:33:49.828122 12126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.827779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:36933 (local address 127.0.0.1:42762)
0808 08:33:49.827980 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:49.828044 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260808 08:33:49.828267 11596 catalog_manager.cc:4584] TS 44b08f64afde4f0791a69b97e1c74126 (127.25.170.1:36933): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fbc18ec14b65400b93e265f5ad370598: Network error: Client connection negotiation failed: client connection to 127.25.170.1:36933: connect: Connection refused (error 111)
I20260808 08:33:49.836750 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 11973
I20260808 08:33:49.844630 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 11577
2026-08-08T08:33:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2412 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T08:33:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:49Z Disabled control of system clock
I20260808 08:33:49.877207 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:46821
--webserver_interface=127.25.170.62
--webserver_port=0
--builtin_ntp_servers=127.25.170.20:39595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:46821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:33:49.986817 12163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:49.987051 12163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:49.987103 12163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:49.991036 12163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:49.991091 12163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:49.991107 12163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:49.991123 12163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:49.991138 12163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:49.995666 12163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:46821
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:46821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:49.996703 12163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:49.997993 12163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:33:50.006400 12163 server_base.cc:1034] running on GCE node
W20260808 08:33:50.006419 12171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:50.006413 12169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:50.006599 12168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:50.007194 12163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:50.008349 12163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:50.009539 12163 hybrid_clock.cc:648] HybridClock initialized: now 1786178030009512 us; error 38 us; skew 500 ppm
I20260808 08:33:50.011413 12163 webserver.cc:460] Webserver started at http://127.25.170.62:35685/ using document root <none> and password file <none>
I20260808 08:33:50.012091 12163 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:50.012189 12163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:50.012432 12163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:50.014482 12163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "75aaa55ce2a37e9475f50e6c6f0b4962"
server_key_iv: "88594bc205d19b8d28c4b9baeb4d7e49"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.015057 12163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "75aaa55ce2a37e9475f50e6c6f0b4962"
server_key_iv: "88594bc205d19b8d28c4b9baeb4d7e49"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.018687 12163 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260808 08:33:50.021113 12178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.022280 12163 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:33:50.022421 12163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "75aaa55ce2a37e9475f50e6c6f0b4962"
server_key_iv: "88594bc205d19b8d28c4b9baeb4d7e49"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.022531 12163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:50.035462 12163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:50.036121 12163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:50.036314 12163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:50.043154 12163 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:46821
I20260808 08:33:50.043174 12237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:46821 every 8 connection(s)
I20260808 08:33:50.044124 12163 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:50.047114 12238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:50.052398 12238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf: Bootstrap starting.
I20260808 08:33:50.052754 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 12163
I20260808 08:33:50.052891 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:33:50.053194 26280 external_mini_cluster.cc:1428] Setting key 5f808f76c88954be5fdf244645216348
I20260808 08:33:50.055145 12238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:50.055863 12238 log.cc:824] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:50.057832 12238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf: No bootstrap required, opened a new log
I20260808 08:33:50.061556 12238 raft_consensus.cc:348] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46821 } }
I20260808 08:33:50.061849 12238 raft_consensus.cc:374] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:50.061929 12238 raft_consensus.cc:729] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e73e63197fd04d7d9d4f6bb728f4e7cf, State: Initialized, Role: FOLLOWER
I20260808 08:33:50.062388 12238 consensus_queue.cc:260] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46821 } }
I20260808 08:33:50.062510 12238 raft_consensus.cc:388] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:50.062593 12238 raft_consensus.cc:482] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:50.062598 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.054496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34792 (local address 127.25.170.62:46821)
0808 08:33:50.055123 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.055137 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.055171 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:33:50.055831 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.055847 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.056320 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.056661 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:50.057090 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.058206 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.059120 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.059607 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.059795 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.060759 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:50.060763 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:50.060776 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:50.061142 (+ 366us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:50.061196 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:50.061216 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:50.061332 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.061502 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.061752 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":128,"threads_started":1}
I20260808 08:33:50.062721 12238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:50.063547 12238 raft_consensus.cc:504] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46821 } }
I20260808 08:33:50.063886 12238 leader_election.cc:302] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e73e63197fd04d7d9d4f6bb728f4e7cf; no voters:
I20260808 08:33:50.064262 12238 leader_election.cc:288] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:50.064327 12243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:50.064528 12243 raft_consensus.cc:686] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [term 1 LEADER]: Becoming Leader. State: Replica: e73e63197fd04d7d9d4f6bb728f4e7cf, State: Running, Role: LEADER
I20260808 08:33:50.064890 12243 consensus_queue.cc:237] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46821 } }
I20260808 08:33:50.065490 12238 sys_catalog.cc:564] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:50.066507 12244 sys_catalog.cc:455] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46821 } } }
I20260808 08:33:50.066718 12244 sys_catalog.cc:458] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:50.066922 12245 sys_catalog.cc:455] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader e73e63197fd04d7d9d4f6bb728f4e7cf. Latest consensus state: current_term: 1 leader_uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e73e63197fd04d7d9d4f6bb728f4e7cf" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46821 } } }
I20260808 08:33:50.067106 12245 sys_catalog.cc:458] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:50.067196 12252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:50.070199 12252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:50.075461 12252 catalog_manager.cc:1347] Generated new cluster ID: d917fcfeb125423bafeabb6849220500
I20260808 08:33:50.075520 12252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:50.086539 12252 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:50.087634 12252 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:50.093900 12252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf: Generated new TSK 0
I20260808 08:33:50.094617 12252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:33:50.101011 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46821
--builtin_ntp_servers=127.25.170.20:39595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:33:50.220999 12263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:50.221297 12263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:50.221370 12263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:50.225301 12263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:50.225349 12263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:50.225442 12263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:33:50.230221 12263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:50.231217 12263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:50.232692 12263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:50.242074 12269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:50.242074 12270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:50.242549 12272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:50.243175 12263 server_base.cc:1034] running on GCE node
I20260808 08:33:50.243573 12263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:50.244243 12263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:50.245434 12263 hybrid_clock.cc:648] HybridClock initialized: now 1786178030245398 us; error 43 us; skew 500 ppm
I20260808 08:33:50.247370 12263 webserver.cc:460] Webserver started at http://127.25.170.1:42853/ using document root <none> and password file <none>
I20260808 08:33:50.247997 12263 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:50.248066 12263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:50.248306 12263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:50.250319 12263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "ccf94403659f4d2caad6b47cb49e1b57"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "2e9148e7ee9cce46c74054924a005564"
server_key_iv: "92a81cea411c64637b6d0c3fb14c8642"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.250892 12263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "ccf94403659f4d2caad6b47cb49e1b57"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "2e9148e7ee9cce46c74054924a005564"
server_key_iv: "92a81cea411c64637b6d0c3fb14c8642"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.255111 12263 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 08:33:50.257710 12278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.259020 12263 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:33:50.259116 12263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "ccf94403659f4d2caad6b47cb49e1b57"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "2e9148e7ee9cce46c74054924a005564"
server_key_iv: "92a81cea411c64637b6d0c3fb14c8642"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.259219 12263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:50.288110 12263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:50.288734 12263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:50.288894 12263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:50.289413 12263 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:50.290300 12263 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:50.290346 12263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.290385 12263 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:50.290405 12263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.299048 12263 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:35885
I20260808 08:33:50.299093 12397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:35885 every 8 connection(s)
I20260808 08:33:50.299970 12263 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:50.302583 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 12263
I20260808 08:33:50.302711 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:50.303027 26280 external_mini_cluster.cc:1428] Setting key 04bb62cdc4b6e46ced6a7eb8602a7f4e
I20260808 08:33:50.305095 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46821
--builtin_ntp_servers=127.25.170.20:39595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:33:50.309530 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.301737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:39039 (local address 127.25.170.62:46821)
0808 08:33:50.301880 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.301883 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.303020 (+ 1137us) server_negotiation.cc:407] Connection header received
0808 08:33:50.304714 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.304717 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.304772 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.304855 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:50.305851 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.306395 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.307547 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.307776 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.307895 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.309014 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:50.309018 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:50.309020 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:50.309033 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:50.309061 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:50.309069 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:50.309144 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.309320 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.309387 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:33:50.310338 12400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.302121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:46821 (local address 127.25.170.1:39039)
0808 08:33:50.302873 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.302914 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:50.304505 (+ 1591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:50.305043 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:50.305050 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:50.305134 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:50.305703 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.305716 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.306526 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.306531 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.307414 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.307423 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.307956 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.307962 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.308138 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.308750 (+ 612us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:33:50.308752 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:50.308790 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:33:50.308860 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:50.309160 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:50.309172 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:50.309179 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:33:50.309314 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 08:33:50.309585 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":172,"threads_started":1}
I20260808 08:33:50.311632 12398 heartbeater.cc:347] Connected to a master server at 127.25.170.62:46821
I20260808 08:33:50.311870 12398 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:50.312425 12398 heartbeater.cc:511] Master 127.25.170.62:46821 requested a full tablet report, sending...
I20260808 08:33:50.314141 12197 ts_manager.cc:194] Registered new tserver with Master: ccf94403659f4d2caad6b47cb49e1b57 (127.25.170.1:35885)
I20260808 08:33:50.315881 12197 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.1:39039
W20260808 08:33:50.422116 12401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:50.422350 12401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:50.422389 12401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:50.426411 12401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:50.426460 12401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:50.426512 12401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:33:50.431154 12401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:50.432232 12401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:50.433550 12401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:50.442866 12409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:50.442876 12406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:50.443039 12401 server_base.cc:1034] running on GCE node
W20260808 08:33:50.442935 12407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:50.443617 12401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:50.444271 12401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:50.445459 12401 hybrid_clock.cc:648] HybridClock initialized: now 1786178030445427 us; error 44 us; skew 500 ppm
I20260808 08:33:50.447238 12401 webserver.cc:460] Webserver started at http://127.25.170.2:37505/ using document root <none> and password file <none>
I20260808 08:33:50.447795 12401 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:50.447886 12401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:50.448120 12401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:50.450071 12401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "d0083291ac974dee85d72a1f83d42609"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "29e770740960f5d11acb9bae65b80757"
server_key_iv: "c06243d94ab13e01437e5f5aacc49282"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.450579 12401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "d0083291ac974dee85d72a1f83d42609"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "29e770740960f5d11acb9bae65b80757"
server_key_iv: "c06243d94ab13e01437e5f5aacc49282"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.454075 12401 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:33:50.456319 12415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.457480 12401 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:50.457614 12401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "d0083291ac974dee85d72a1f83d42609"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "29e770740960f5d11acb9bae65b80757"
server_key_iv: "c06243d94ab13e01437e5f5aacc49282"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.457724 12401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:50.470788 12401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:50.471459 12401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:50.471658 12401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:50.472259 12401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:50.473160 12401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:50.473230 12401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.473307 12401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:50.473351 12401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.482640 12401 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:44365
I20260808 08:33:50.483153 12535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:44365 every 8 connection(s)
I20260808 08:33:50.483800 12401 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:50.493409 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 12401
I20260808 08:33:50.493563 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:50.493975 26280 external_mini_cluster.cc:1428] Setting key 03cd5a5e234adffb30e1b1844f922d7d
I20260808 08:33:50.496404 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46821
--builtin_ntp_servers=127.25.170.20:39595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:33:50.496651 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.486156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:53735 (local address 127.25.170.62:46821)
0808 08:33:50.486324 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.486330 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.487582 (+ 1252us) server_negotiation.cc:407] Connection header received
0808 08:33:50.489602 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.489609 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.489679 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.489787 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:50.491205 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.492105 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.494048 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.494416 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.494510 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.495978 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:50.495984 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:50.495988 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:50.496005 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:50.496029 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:50.496038 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:50.496145 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.496404 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.496473 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:33:50.497752 12538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.486577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:46821 (local address 127.25.170.2:53735)
0808 08:33:50.487391 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.487445 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:50.489325 (+ 1880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:50.490145 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:50.490154 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:50.490287 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:50.491020 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.491046 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.492266 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.492272 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.493874 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.493891 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.494747 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.494752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.494961 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.495621 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:33:50.495623 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:50.495674 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:33:50.495751 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:50.496164 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:50.496176 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:50.496186 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:33:50.496394 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 08:33:50.496717 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":109,"threads_started":1}
I20260808 08:33:50.498962 12536 heartbeater.cc:347] Connected to a master server at 127.25.170.62:46821
I20260808 08:33:50.499219 12536 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:50.499851 12536 heartbeater.cc:511] Master 127.25.170.62:46821 requested a full tablet report, sending...
I20260808 08:33:50.501094 12197 ts_manager.cc:194] Registered new tserver with Master: d0083291ac974dee85d72a1f83d42609 (127.25.170.2:44365)
I20260808 08:33:50.501906 12197 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.2:53735
W20260808 08:33:50.625803 12539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:50.626082 12539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:50.626153 12539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:50.630218 12539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:50.630290 12539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:50.630384 12539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:33:50.635012 12539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:39595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:50.636096 12539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:50.637507 12539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:50.646835 12546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:50.646826 12545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:50.646816 12549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:50.647083 12539 server_base.cc:1034] running on GCE node
I20260808 08:33:50.647541 12539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:50.648192 12539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:50.649375 12539 hybrid_clock.cc:648] HybridClock initialized: now 1786178030649366 us; error 26 us; skew 500 ppm
I20260808 08:33:50.651033 12539 webserver.cc:460] Webserver started at http://127.25.170.3:41973/ using document root <none> and password file <none>
I20260808 08:33:50.651592 12539 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:50.651681 12539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:50.651978 12539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:50.654076 12539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "2b1020d3fdb744f79320d8b05dcf928f"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "07add9e31074f49cacdf7752ba3340ae"
server_key_iv: "ecbb4fae400b15669e175feabd00cb4f"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.654639 12539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "2b1020d3fdb744f79320d8b05dcf928f"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "07add9e31074f49cacdf7752ba3340ae"
server_key_iv: "ecbb4fae400b15669e175feabd00cb4f"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.658169 12539 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260808 08:33:50.660650 12556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.661819 12539 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 08:33:50.661948 12539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "2b1020d3fdb744f79320d8b05dcf928f"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-zkpd"
server_key: "07add9e31074f49cacdf7752ba3340ae"
server_key_iv: "ecbb4fae400b15669e175feabd00cb4f"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.662055 12539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:50.677189 12539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:50.677804 12539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:50.677989 12539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:50.678529 12539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:50.679425 12539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:50.679494 12539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.679559 12539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:50.679610 12539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.688611 12539 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:33399
I20260808 08:33:50.688644 12678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:33399 every 8 connection(s)
I20260808 08:33:50.689538 12539 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:50.694584 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 12539
I20260808 08:33:50.694702 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:50.695032 26280 external_mini_cluster.cc:1428] Setting key 2d87f3c93a5edeb686f55d7890196a84
I20260808 08:33:50.699453 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.691348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:58079 (local address 127.25.170.62:46821)
0808 08:33:50.691498 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.691502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.692565 (+ 1063us) server_negotiation.cc:407] Connection header received
0808 08:33:50.693949 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.693951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.693996 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.694068 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:50.695233 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.695890 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.697504 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.697725 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.697805 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.699010 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:50.699013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:50.699015 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:50.699026 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:50.699046 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:50.699054 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:50.699111 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.699276 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.699335 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:33:50.700222 12681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.691737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:46821 (local address 127.25.170.3:58079)
0808 08:33:50.692441 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.692481 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:50.693756 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:50.694234 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:50.694240 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:50.694359 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:50.695071 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.695091 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.696069 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.696073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.697401 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.697412 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.697893 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.697899 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.698134 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.698754 (+ 620us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:33:50.698755 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:50.698794 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:33:50.698879 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:50.699138 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:50.699145 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:50.699149 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:33:50.699236 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 08:33:50.699471 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":175,"threads_started":1}
I20260808 08:33:50.701174 12679 heartbeater.cc:347] Connected to a master server at 127.25.170.62:46821
I20260808 08:33:50.701411 12679 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:50.701889 12679 heartbeater.cc:511] Master 127.25.170.62:46821 requested a full tablet report, sending...
I20260808 08:33:50.702878 12197 ts_manager.cc:194] Registered new tserver with Master: 2b1020d3fdb744f79320d8b05dcf928f (127.25.170.3:33399)
I20260808 08:33:50.703456 12197 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.3:58079
I20260808 08:33:50.708895 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:33:50.714143 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.710783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36670 (local address 127.25.170.62:46821)
0808 08:33:50.710894 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.710897 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.711080 (+ 183us) server_negotiation.cc:407] Connection header received
0808 08:33:50.711151 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.711153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.711186 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.711248 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:50.711501 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.712028 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.712862 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.713066 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.713136 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.713845 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:50.713848 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:50.713850 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:50.713860 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:50.713876 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:50.713883 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:50.713939 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.714013 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.714054 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:33:50.717278 12197 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36670:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:50.720366 12197 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:50.734855 12690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.728669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:33399 (local address 127.0.0.1:40668)
0808 08:33:50.729100 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.729156 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:50.729254 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:50.730073 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:50.730080 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:50.730107 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:50.730255 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.730262 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.731845 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.731848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.733300 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.733311 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.734344 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.734348 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.734442 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.734491 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 08:33:50.734594 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 08:33:50.734682 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":39,"thread_start_us":63,"threads_started":1}
I20260808 08:33:50.734915 12692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.728813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40668 (local address 127.25.170.3:33399)
0808 08:33:50.729556 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.729568 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.729591 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:33:50.729669 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.729674 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.729881 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.730411 (+ 530us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:50.730572 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.731723 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.733411 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.734186 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.734396 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.734545 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.734620 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.734720 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":153,"threads_started":1}
I20260808 08:33:50.735194 12695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.729581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52912 (local address 127.25.170.1:35885)
0808 08:33:50.730030 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.730042 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.730540 (+ 498us) server_negotiation.cc:407] Connection header received
0808 08:33:50.730649 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.730653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.730782 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.730946 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:50.731176 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.732017 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.733360 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.734186 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.734304 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.734496 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.734940 (+ 444us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.735043 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":115,"threads_started":1}
I20260808 08:33:50.735219 12693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.729386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:35885 (local address 127.0.0.1:52912)
0808 08:33:50.730338 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.730352 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:50.730438 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:50.730926 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:50.730929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:50.730948 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:50.731048 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.731057 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.732143 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.732146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.733217 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.733229 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.734556 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.734563 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.734655 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.734678 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:33:50.734771 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 08:33:50.734856 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":891,"mutex_wait_us":3,"thread_start_us":92,"threads_started":1}
I20260808 08:33:50.735579 12691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.728758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:44365 (local address 127.0.0.1:35972)
0808 08:33:50.730057 (+ 1299us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.730069 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:50.730167 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:50.730764 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:50.730767 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:50.730785 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:50.730883 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.730889 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.732272 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.732276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.733430 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.733441 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.734238 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.734241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.734347 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.735230 (+ 883us) client_negotiation.cc:769] Sending connection context
0808 08:33:50.735309 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 08:33:50.735375 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1230,"mutex_wait_us":22,"thread_start_us":92,"threads_started":1}
I20260808 08:33:50.735755 12694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.729454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35972 (local address 127.25.170.2:44365)
0808 08:33:50.729811 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.729822 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.730176 (+ 354us) server_negotiation.cc:407] Connection header received
0808 08:33:50.730265 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.730270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.730461 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.730623 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:50.731018 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.732156 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.733561 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.734109 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.734237 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.734447 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.735454 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.735567 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":159,"threads_started":1}
I20260808 08:33:50.737846 12327 tablet_service.cc:1467] Processing CreateTablet for tablet e7cbe68332f046ff9816905d6aee5e76 (DEFAULT_TABLE table=test-table [id=5af45a339676437b98d69107184840a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:50.737823 12608 tablet_service.cc:1467] Processing CreateTablet for tablet e7cbe68332f046ff9816905d6aee5e76 (DEFAULT_TABLE table=test-table [id=5af45a339676437b98d69107184840a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:50.738690 12608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7cbe68332f046ff9816905d6aee5e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:50.738691 12327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7cbe68332f046ff9816905d6aee5e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:50.741693 12464 tablet_service.cc:1467] Processing CreateTablet for tablet e7cbe68332f046ff9816905d6aee5e76 (DEFAULT_TABLE table=test-table [id=5af45a339676437b98d69107184840a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:50.742676 12464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7cbe68332f046ff9816905d6aee5e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:50.745333 12696 tablet_bootstrap.cc:492] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57: Bootstrap starting.
I20260808 08:33:50.746256 12697 tablet_bootstrap.cc:492] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: Bootstrap starting.
I20260808 08:33:50.747434 12696 tablet_bootstrap.cc:654] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:50.748287 12696 log.cc:824] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:50.748409 12697 tablet_bootstrap.cc:654] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:50.749235 12697 log.cc:824] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:50.749601 12699 tablet_bootstrap.cc:492] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: Bootstrap starting.
I20260808 08:33:50.750941 12696 tablet_bootstrap.cc:492] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57: No bootstrap required, opened a new log
I20260808 08:33:50.751134 12696 ts_tablet_manager.cc:1397] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:33:50.751308 12697 tablet_bootstrap.cc:492] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: No bootstrap required, opened a new log
I20260808 08:33:50.751495 12697 ts_tablet_manager.cc:1397] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260808 08:33:50.751689 12699 tablet_bootstrap.cc:654] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:50.752561 12699 log.cc:824] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:50.754544 12699 tablet_bootstrap.cc:492] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: No bootstrap required, opened a new log
I20260808 08:33:50.754726 12699 ts_tablet_manager.cc:1397] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:33:50.755053 12697 raft_consensus.cc:348] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 } } peers { permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 } } peers { permanent_uuid: "ccf94403659f4d2caad6b47cb49e1b57" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35885 } }
I20260808 08:33:50.755272 12697 raft_consensus.cc:374] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:50.755331 12697 raft_consensus.cc:729] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b1020d3fdb744f79320d8b05dcf928f, State: Initialized, Role: FOLLOWER
I20260808 08:33:50.755548 12696 raft_consensus.cc:348] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 } } peers { permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 } } peers { permanent_uuid: "ccf94403659f4d2caad6b47cb49e1b57" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35885 } }
I20260808 08:33:50.755790 12696 raft_consensus.cc:374] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:50.755750 12697 consensus_queue.cc:260] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 } } peers { permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 } } peers { permanent_uuid: "ccf94403659f4d2caad6b47cb49e1b57" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35885 } }
I20260808 08:33:50.755860 12696 raft_consensus.cc:729] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccf94403659f4d2caad6b47cb49e1b57, State: Initialized, Role: FOLLOWER
I20260808 08:33:50.756454 12696 consensus_queue.cc:260] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 } } peers { permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 } } peers { permanent_uuid: "ccf94403659f4d2caad6b47cb49e1b57" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35885 } }
I20260808 08:33:50.756691 12697 ts_tablet_manager.cc:1428] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260808 08:33:50.757030 12679 heartbeater.cc:503] Master 127.25.170.62:46821 was elected leader, sending a full tablet report...
I20260808 08:33:50.757406 12696 ts_tablet_manager.cc:1428] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:33:50.757768 12398 heartbeater.cc:503] Master 127.25.170.62:46821 was elected leader, sending a full tablet report...
I20260808 08:33:50.759176 12699 raft_consensus.cc:348] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 } } peers { permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 } } peers { permanent_uuid: "ccf94403659f4d2caad6b47cb49e1b57" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35885 } }
I20260808 08:33:50.759451 12699 raft_consensus.cc:374] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:50.759509 12699 raft_consensus.cc:729] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0083291ac974dee85d72a1f83d42609, State: Initialized, Role: FOLLOWER
I20260808 08:33:50.760000 12699 consensus_queue.cc:260] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 } } peers { permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 } } peers { permanent_uuid: "ccf94403659f4d2caad6b47cb49e1b57" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35885 } }
I20260808 08:33:50.760672 12536 heartbeater.cc:503] Master 127.25.170.62:46821 was elected leader, sending a full tablet report...
I20260808 08:33:50.760963 12699 ts_tablet_manager.cc:1428] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260808 08:33:50.801123 12399 tablet.cc:2369] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:50.815294 12703 raft_consensus.cc:482] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:50.815543 12703 raft_consensus.cc:504] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 } } peers { permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 } } peers { permanent_uuid: "ccf94403659f4d2caad6b47cb49e1b57" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35885 } }
I20260808 08:33:50.816768 12703 leader_election.cc:288] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b1020d3fdb744f79320d8b05dcf928f (127.25.170.3:33399), d0083291ac974dee85d72a1f83d42609 (127.25.170.2:44365)
I20260808 08:33:50.821801 12694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.817139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:53421 (local address 127.25.170.2:44365)
0808 08:33:50.817286 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.817291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.817770 (+ 479us) server_negotiation.cc:407] Connection header received
0808 08:33:50.817833 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.817835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.817877 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.817935 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:50.818212 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.818929 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.820514 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.821115 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.821237 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.821288 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.821599 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.821671 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:33:50.821810 12692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.817152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:52599 (local address 127.25.170.3:33399)
0808 08:33:50.817307 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.817311 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.817423 (+ 112us) server_negotiation.cc:407] Connection header received
0808 08:33:50.817531 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.817534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.817597 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.817665 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:50.818055 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.818837 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.820514 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.821115 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.821237 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.821288 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.821598 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.821671 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:33:50.821929 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.817015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:33399 (local address 127.25.170.1:52599)
0808 08:33:50.817308 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.817324 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:50.817437 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:50.817721 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:50.817725 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:50.817750 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:50.817899 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.817904 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.818946 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.818948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.820383 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.820394 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.821239 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.821242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.821430 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.821494 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 08:33:50.821571 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 08:33:50.821728 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":154,"thread_start_us":93,"threads_started":1}
I20260808 08:33:50.821933 12707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.817015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:44365 (local address 127.25.170.1:53421)
0808 08:33:50.817668 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.817682 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:50.817761 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:50.817970 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:50.817976 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:50.817999 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:50.818109 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.818114 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.819029 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.819031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.820384 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.820394 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.821239 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.821242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.821426 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.821496 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 08:33:50.821571 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 08:33:50.821728 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":443,"thread_start_us":120,"threads_started":1}
I20260808 08:33:50.822597 12630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7cbe68332f046ff9816905d6aee5e76" candidate_uuid: "ccf94403659f4d2caad6b47cb49e1b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b1020d3fdb744f79320d8b05dcf928f" is_pre_election: true
I20260808 08:33:50.822753 12487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7cbe68332f046ff9816905d6aee5e76" candidate_uuid: "ccf94403659f4d2caad6b47cb49e1b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0083291ac974dee85d72a1f83d42609" is_pre_election: true
I20260808 08:33:50.822932 12630 raft_consensus.cc:2454] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccf94403659f4d2caad6b47cb49e1b57 in term 0.
I20260808 08:33:50.823086 12487 raft_consensus.cc:2454] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccf94403659f4d2caad6b47cb49e1b57 in term 0.
I20260808 08:33:50.823469 12283 leader_election.cc:302] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b1020d3fdb744f79320d8b05dcf928f, ccf94403659f4d2caad6b47cb49e1b57; no voters:
I20260808 08:33:50.823740 12703 raft_consensus.cc:2781] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:50.823819 12703 raft_consensus.cc:482] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:50.823876 12703 raft_consensus.cc:3037] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:50.824962 12703 raft_consensus.cc:504] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 } } peers { permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 } } peers { permanent_uuid: "ccf94403659f4d2caad6b47cb49e1b57" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35885 } }
I20260808 08:33:50.825306 12703 leader_election.cc:288] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [CANDIDATE]: Term 1 election: Requested vote from peers 2b1020d3fdb744f79320d8b05dcf928f (127.25.170.3:33399), d0083291ac974dee85d72a1f83d42609 (127.25.170.2:44365)
I20260808 08:33:50.825662 12630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7cbe68332f046ff9816905d6aee5e76" candidate_uuid: "ccf94403659f4d2caad6b47cb49e1b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b1020d3fdb744f79320d8b05dcf928f"
I20260808 08:33:50.825815 12487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7cbe68332f046ff9816905d6aee5e76" candidate_uuid: "ccf94403659f4d2caad6b47cb49e1b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0083291ac974dee85d72a1f83d42609"
I20260808 08:33:50.825835 12630 raft_consensus.cc:3037] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:50.825929 12487 raft_consensus.cc:3037] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:50.827236 12487 raft_consensus.cc:2454] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf94403659f4d2caad6b47cb49e1b57 in term 1.
I20260808 08:33:50.827236 12630 raft_consensus.cc:2454] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccf94403659f4d2caad6b47cb49e1b57 in term 1.
I20260808 08:33:50.827584 12280 leader_election.cc:302] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2b1020d3fdb744f79320d8b05dcf928f, ccf94403659f4d2caad6b47cb49e1b57, d0083291ac974dee85d72a1f83d42609; no voters:
I20260808 08:33:50.827751 12703 raft_consensus.cc:2781] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:50.827977 12703 raft_consensus.cc:686] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 1 LEADER]: Becoming Leader. State: Replica: ccf94403659f4d2caad6b47cb49e1b57, State: Running, Role: LEADER
I20260808 08:33:50.828299 12703 consensus_queue.cc:237] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 } } peers { permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 } } peers { permanent_uuid: "ccf94403659f4d2caad6b47cb49e1b57" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35885 } }
I20260808 08:33:50.831509 12195 catalog_manager.cc:5495] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccf94403659f4d2caad6b47cb49e1b57 (127.25.170.1). New cstate: current_term: 1 leader_uuid: "ccf94403659f4d2caad6b47cb49e1b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccf94403659f4d2caad6b47cb49e1b57" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 35885 } health_report { overall_health: HEALTHY } } }
I20260808 08:33:50.855273 12695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.852005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52916 (local address 127.25.170.1:35885)
0808 08:33:50.852148 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.852152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.852165 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:33:50.852254 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.852256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.852314 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.852428 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:50.852669 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.853172 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.853992 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.854203 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.854283 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.854560 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:50.854972 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:50.855064 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.855117 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.855162 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:33:50.861357 12487 raft_consensus.cc:1261] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609 [term 1 FOLLOWER]: Refusing update from remote peer ccf94403659f4d2caad6b47cb49e1b57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:50.861423 12630 raft_consensus.cc:1261] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f [term 1 FOLLOWER]: Refusing update from remote peer ccf94403659f4d2caad6b47cb49e1b57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:50.862138 12708 consensus_queue.cc:1035] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b1020d3fdb744f79320d8b05dcf928f" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 33399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:50.862315 12703 consensus_queue.cc:1035] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0083291ac974dee85d72a1f83d42609" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:50.870193 12711 mvcc.cc:205] Tried to move back new op lower bound from 7316185214400552960 to 7316185214275588096. Current Snapshot: MvccSnapshot[applied={T|T < 7316185214400552960}]
I20260808 08:33:50.870972 12713 mvcc.cc:205] Tried to move back new op lower bound from 7316185214400552960 to 7316185214275588096. Current Snapshot: MvccSnapshot[applied={T|T < 7316185214400552960}]
I20260808 08:33:50.879359 12197 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:50.879535 12197 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:50.881994 12197 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e73e63197fd04d7d9d4f6bb728f4e7cf: Sending DeleteTablet for 3 replicas of tablet e7cbe68332f046ff9816905d6aee5e76
I20260808 08:33:50.882730 12464 tablet_service.cc:1514] Processing DeleteTablet for tablet e7cbe68332f046ff9816905d6aee5e76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:50 UTC) from {username='slave'} at 127.0.0.1:35972
I20260808 08:33:50.882784 12608 tablet_service.cc:1514] Processing DeleteTablet for tablet e7cbe68332f046ff9816905d6aee5e76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:50 UTC) from {username='slave'} at 127.0.0.1:40668
I20260808 08:33:50.883227 12722 tablet_replica.cc:330] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: stopping tablet replica
I20260808 08:33:50.883272 12723 tablet_replica.cc:330] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: stopping tablet replica
I20260808 08:33:50.883589 12723 raft_consensus.cc:2229] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:50.883623 12327 tablet_service.cc:1514] Processing DeleteTablet for tablet e7cbe68332f046ff9816905d6aee5e76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:50 UTC) from {username='slave'} at 127.0.0.1:52912
I20260808 08:33:50.883605 12722 raft_consensus.cc:2229] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:50.883949 12723 raft_consensus.cc:2258] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:50.884153 12722 raft_consensus.cc:2258] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:50.884939 12724 tablet_replica.cc:330] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57: stopping tablet replica
I20260808 08:33:50.884989 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 12263
I20260808 08:33:50.885190 12724 raft_consensus.cc:2229] T e7cbe68332f046ff9816905d6aee5e76 P ccf94403659f4d2caad6b47cb49e1b57 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:50.886446 12723 ts_tablet_manager.cc:1905] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:50.889078 12722 ts_tablet_manager.cc:1905] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:50.890486 12723 ts_tablet_manager.cc:1918] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:50.890621 12723 log.cc:1196] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/e7cbe68332f046ff9816905d6aee5e76
I20260808 08:33:50.891049 12723 ts_tablet_manager.cc:1939] T e7cbe68332f046ff9816905d6aee5e76 P 2b1020d3fdb744f79320d8b05dcf928f: Deleting consensus metadata
I20260808 08:33:50.891753 12722 ts_tablet_manager.cc:1918] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:50.891867 12722 log.cc:1196] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/e7cbe68332f046ff9816905d6aee5e76
I20260808 08:33:50.892167 12722 ts_tablet_manager.cc:1939] T e7cbe68332f046ff9816905d6aee5e76 P d0083291ac974dee85d72a1f83d42609: Deleting consensus metadata
I20260808 08:33:50.892567 12182 catalog_manager.cc:4841] TS 2b1020d3fdb744f79320d8b05dcf928f (127.25.170.3:33399): tablet e7cbe68332f046ff9816905d6aee5e76 (table test-table [id=5af45a339676437b98d69107184840a4]) successfully deleted
I20260808 08:33:50.893306 12180 catalog_manager.cc:4841] TS d0083291ac974dee85d72a1f83d42609 (127.25.170.2:44365): tablet e7cbe68332f046ff9816905d6aee5e76 (table test-table [id=5af45a339676437b98d69107184840a4]) successfully deleted
W20260808 08:33:50.898773 12182 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:35885 (error 108)
I20260808 08:33:50.899595 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 12401
I20260808 08:33:50.899855 12693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.899508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:35885 (local address 127.0.0.1:52918)
0808 08:33:50.899668 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.899752 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:35885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:33:50.901551 12182 catalog_manager.cc:4584] TS ccf94403659f4d2caad6b47cb49e1b57 (127.25.170.1:35885): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e7cbe68332f046ff9816905d6aee5e76: Network error: Client connection negotiation failed: client connection to 127.25.170.1:35885: connect: Connection refused (error 111)
I20260808 08:33:50.906773 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 12539
I20260808 08:33:50.914155 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 12163
2026-08-08T08:33:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1068 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:50 dist-test-slave-zkpd krb5kdc[12728](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:50 dist-test-slave-zkpd krb5kdc[12728](info): set up 2 sockets
Aug 08 08:33:50 dist-test-slave-zkpd krb5kdc[12728](info): commencing operation
krb5kdc: starting...
W20260808 08:33:51.981621 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:33:52 dist-test-slave-zkpd krb5kdc[12728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:33:52.103858 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:45623
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:45623
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:52.216208 12741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:52.216451 12741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:52.216490 12741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:52.220506 12741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:52.220564 12741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:52.220584 12741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:52.220602 12741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:52.220616 12741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:52.225644 12741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:45623
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:45623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:52.226598 12741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:52.227564 12741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:33:52.236621 12741 server_base.cc:1034] running on GCE node
W20260808 08:33:52.236632 12750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:52.236678 12748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:52.236605 12747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:52.237411 12741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:52.238497 12741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:52.239694 12741 hybrid_clock.cc:648] HybridClock initialized: now 1786178032239680 us; error 28 us; skew 500 ppm
Aug 08 08:33:52 dist-test-slave-zkpd krb5kdc[12728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:52.242820 12741 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:33:52.243747 12741 webserver.cc:460] Webserver started at http://127.25.170.62:42423/ using document root <none> and password file <none>
I20260808 08:33:52.244377 12741 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:52.244470 12741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:52.244701 12741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:52.246749 12741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "634baa4b2e8c040f454a09f05a1a5dae"
server_key_iv: "50b98a06fe6350c94a42e197bfe2f866"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.247357 12741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "634baa4b2e8c040f454a09f05a1a5dae"
server_key_iv: "50b98a06fe6350c94a42e197bfe2f866"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.251121 12741 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:33:52.253469 12757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:52.254681 12741 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:33:52.254834 12741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "634baa4b2e8c040f454a09f05a1a5dae"
server_key_iv: "50b98a06fe6350c94a42e197bfe2f866"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.254946 12741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:52.269529 12741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:52.272614 12741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:52.272831 12741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:52.280309 12741 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:45623
I20260808 08:33:52.280333 12813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:45623 every 8 connection(s)
I20260808 08:33:52.281275 12741 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:52.284430 12814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:52.290016 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 12741
I20260808 08:33:52.290155 12814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d: Bootstrap starting.
I20260808 08:33:52.290192 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:33:52.290518 26280 external_mini_cluster.cc:1428] Setting key 4961806104a62e256f6023da70307784
I20260808 08:33:52.292855 12814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:52.293583 12814 log.cc:824] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:52.295478 12814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d: No bootstrap required, opened a new log
Aug 08 08:33:52 dist-test-slave-zkpd krb5kdc[12728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:52.299449 12814 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45623 } }
I20260808 08:33:52.299753 12814 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:52.299822 12814 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1736fbe0d31c4462a38c51c8b9f4ad6d, State: Initialized, Role: FOLLOWER
I20260808 08:33:52.300311 12814 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45623 } }
I20260808 08:33:52.300439 12814 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:52.300523 12814 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:52.300614 12814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:52.301496 12814 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45623 } }
I20260808 08:33:52.301844 12814 leader_election.cc:302] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1736fbe0d31c4462a38c51c8b9f4ad6d; no voters:
I20260808 08:33:52.302135 12814 leader_election.cc:288] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:52.302270 12819 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:52.302490 12819 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [term 1 LEADER]: Becoming Leader. State: Replica: 1736fbe0d31c4462a38c51c8b9f4ad6d, State: Running, Role: LEADER
I20260808 08:33:52.302793 12819 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45623 } }
I20260808 08:33:52.303506 12814 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:52.304695 12822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1736fbe0d31c4462a38c51c8b9f4ad6d. Latest consensus state: current_term: 1 leader_uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45623 } } }
I20260808 08:33:52.304694 12820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1736fbe0d31c4462a38c51c8b9f4ad6d" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45623 } } }
I20260808 08:33:52.304852 12822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:52.304852 12820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:52.305320 12829 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:52.305747 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:52.291990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45198 (local address 127.25.170.62:45623)
0808 08:33:52.292410 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:52.292425 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:52.292461 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:33:52.293170 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:52.293189 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:52.293522 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:52.293920 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:52.294715 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.295741 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.296693 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.297168 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.297347 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:52.300180 (+ 2833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:52.300186 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:52.300203 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:52.300237 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:52.302220 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:52.302744 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:52.302750 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:52.302755 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:52.302895 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:52.303221 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:52.303224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:52.303226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:52.303726 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:52.303983 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:52.304301 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 08:33:52.304651 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":123,"threads_started":1}
I20260808 08:33:52.308485 12829 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:52.313864 12829 catalog_manager.cc:1347] Generated new cluster ID: 889cdd45e00546b38476ab1bca993eaa
I20260808 08:33:52.313926 12829 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:52.325634 12829 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:52.326821 12829 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:52.340124 12829 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d: Generated new TSK 0
I20260808 08:33:52.340770 12829 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:33:52.378558 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:45623
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:52.520825 12841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:52.521066 12841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:52.521108 12841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:52.525372 12841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:52.525429 12841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:52.525519 12841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:33:52.530656 12841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:52.531683 12841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:52.532791 12841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:52.542397 12847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:52.542382 12841 server_base.cc:1034] running on GCE node
W20260808 08:33:52.542382 12850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:52.542397 12848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:52.543045 12841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:52.543601 12841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:52.544786 12841 hybrid_clock.cc:648] HybridClock initialized: now 1786178032544751 us; error 46 us; skew 500 ppm
Aug 08 08:33:52 dist-test-slave-zkpd krb5kdc[12728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:52.552255 12841 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:33:52.553100 12841 webserver.cc:460] Webserver started at http://127.25.170.1:35133/ using document root <none> and password file <none>
I20260808 08:33:52.553666 12841 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:52.553769 12841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:52.554008 12841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:52.556094 12841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "36a5e66a7e3e4192ad886c033c818770"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "2409acabb9328cafa7be7343fde1bfe1"
server_key_iv: "b762d6b2929f69a7f76f3ae68fa57a9e"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.556658 12841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "36a5e66a7e3e4192ad886c033c818770"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "2409acabb9328cafa7be7343fde1bfe1"
server_key_iv: "b762d6b2929f69a7f76f3ae68fa57a9e"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.560475 12841 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:33:52.562911 12858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:52.564162 12841 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:52.564287 12841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "36a5e66a7e3e4192ad886c033c818770"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "2409acabb9328cafa7be7343fde1bfe1"
server_key_iv: "b762d6b2929f69a7f76f3ae68fa57a9e"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.564394 12841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:52.584748 12841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:52.588088 12841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:52.588287 12841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:52.588852 12841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:52.589659 12841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:52.589747 12841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:52.589828 12841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:52.589877 12841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:52.599117 12841 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:43931
I20260808 08:33:52.599188 12978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:43931 every 8 connection(s)
I20260808 08:33:52.600055 12841 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:52.605974 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 12841
I20260808 08:33:52.606112 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:52.606415 26280 external_mini_cluster.cc:1428] Setting key 0e2386819318a6858d945969d7cb95cb
Aug 08 08:33:52 dist-test-slave-zkpd krb5kdc[12728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:52.614228 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:52.601836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:48101 (local address 127.25.170.62:45623)
0808 08:33:52.601977 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:52.601980 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:52.602797 (+ 817us) server_negotiation.cc:407] Connection header received
0808 08:33:52.604287 (+ 1490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:52.604290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:52.604338 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:52.604407 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:52.605663 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.606345 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.607782 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.608128 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.608240 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:52.610645 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:52.610649 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:52.610652 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:52.610685 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:52.612198 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:52.612697 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:52.612701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:52.612703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:52.612785 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:52.613121 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:52.613125 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:52.613127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:52.613304 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:52.613420 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:52.613929 (+ 509us) server_negotiation.cc:299] Negotiation successful
0808 08:33:52.614055 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:33:52.615013 12982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:52.602201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:45623 (local address 127.25.170.1:48101)
0808 08:33:52.602647 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:52.602689 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:52.604049 (+ 1360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:52.604585 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:52.604592 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:52.605049 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:52.605542 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:52.605556 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.606474 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.606479 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:52.607657 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:52.607668 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.608280 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.608283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:52.608434 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:52.609030 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:52.609046 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:52.610454 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:52.612318 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:52.612324 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:52.612338 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:52.612594 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:52.612881 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:52.612884 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:52.612885 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:52.613026 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:52.613418 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:52.613425 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:52.613665 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 08:33:52.613885 (+ 220us) client_negotiation.cc:240] Negotiation successful
0808 08:33:52.614202 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":136,"threads_started":1}
I20260808 08:33:52.616364 12980 heartbeater.cc:347] Connected to a master server at 127.25.170.62:45623
I20260808 08:33:52.616612 12980 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
I20260808 08:33:52.617156 12980 heartbeater.cc:511] Master 127.25.170.62:45623 requested a full tablet report, sending...
I20260808 08:33:52.618661 12777 ts_manager.cc:194] Registered new tserver with Master: 36a5e66a7e3e4192ad886c033c818770 (127.25.170.1:43931)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:33:52.620127 12777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:48101
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:33:52.632305 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:45623
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:52.743649 12985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:52.743878 12985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:52.744021 12985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:52.748034 12985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:52.748082 12985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:52.748183 12985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:33:52.753247 12985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:52.754238 12985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:52.755251 12985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:52.764668 12990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:52.764873 12985 server_base.cc:1034] running on GCE node
W20260808 08:33:52.764668 12993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:52.764665 12991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:52.765408 12985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:52.765966 12985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:52.767118 12985 hybrid_clock.cc:648] HybridClock initialized: now 1786178032767102 us; error 28 us; skew 500 ppm
Aug 08 08:33:52 dist-test-slave-zkpd krb5kdc[12728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:52.769955 12985 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:33:52.770808 12985 webserver.cc:460] Webserver started at http://127.25.170.2:46461/ using document root <none> and password file <none>
I20260808 08:33:52.771337 12985 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:52.771395 12985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:52.771657 12985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:52.773679 12985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "fdb2acfb94e34cf783e29260da95a122"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "dbec4185e98da5c3b4b6c9b7e419c4f5"
server_key_iv: "02a1a45310c7126c16d8ef6f421849bd"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.774282 12985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "fdb2acfb94e34cf783e29260da95a122"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "dbec4185e98da5c3b4b6c9b7e419c4f5"
server_key_iv: "02a1a45310c7126c16d8ef6f421849bd"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.777833 12985 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:33:52.780126 13000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:52.781304 12985 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:33:52.781423 12985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "fdb2acfb94e34cf783e29260da95a122"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "dbec4185e98da5c3b4b6c9b7e419c4f5"
server_key_iv: "02a1a45310c7126c16d8ef6f421849bd"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.781524 12985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:52.796509 12985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:52.799211 12985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:52.799407 12985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:52.800057 12985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:52.800860 12985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:52.800905 12985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:52.800972 12985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:52.801009 12985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:52.810597 12985 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:32893
I20260808 08:33:52.810617 13119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:32893 every 8 connection(s)
I20260808 08:33:52.811510 12985 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:52.818233 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 12985
I20260808 08:33:52.818382 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:52.818674 26280 external_mini_cluster.cc:1428] Setting key f1c66bafc3a78fe99e9ce39dce33eedf
Aug 08 08:33:52 dist-test-slave-zkpd krb5kdc[12728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:52.825835 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:52.813366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:41339 (local address 127.25.170.62:45623)
0808 08:33:52.813491 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:52.813495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:52.814348 (+ 853us) server_negotiation.cc:407] Connection header received
0808 08:33:52.815667 (+ 1319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:52.815671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:52.815730 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:52.815833 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:52.817037 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.817569 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.819121 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.819455 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.819572 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:52.822225 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:52.822229 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:52.822231 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:52.822253 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:52.823683 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:52.824269 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:52.824273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:52.824275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:52.824366 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:52.824716 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:52.824719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:52.824721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:52.824904 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:52.825012 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:52.825539 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 08:33:52.825659 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 08:33:52.826638 13122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:52.813742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:45623 (local address 127.25.170.2:41339)
0808 08:33:52.814189 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:52.814231 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:52.815451 (+ 1220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:52.816064 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:52.816071 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:52.816411 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:52.816886 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:52.816900 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.817705 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.817708 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:52.818984 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:52.818997 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.819614 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.819618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:52.819785 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:52.820395 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:52.820417 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:52.822041 (+ 1624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:52.823816 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:52.823822 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:52.823837 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:52.824161 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:52.824461 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:52.824464 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:52.824466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:52.824610 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:52.825012 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:52.825020 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:52.825282 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 08:33:52.825481 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 08:33:52.825818 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":115,"threads_started":1}
I20260808 08:33:52.827819 13120 heartbeater.cc:347] Connected to a master server at 127.25.170.62:45623
I20260808 08:33:52.828125 13120 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:52.828778 13120 heartbeater.cc:511] Master 127.25.170.62:45623 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
I20260808 08:33:52.829924 12777 ts_manager.cc:194] Registered new tserver with Master: fdb2acfb94e34cf783e29260da95a122 (127.25.170.2:32893)
I20260808 08:33:52.830508 12777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:41339
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:33:52.846689 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:45623
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:52.960093 13125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:52.960341 13125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:52.960384 13125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:52.964705 13125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:52.964761 13125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:52.964818 13125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:33:52.970522 13125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:52.971488 13125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:52.972606 13125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:52.982059 13131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:52.982084 13133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:52.982348 13125 server_base.cc:1034] running on GCE node
W20260808 08:33:52.982059 13130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:52.982882 13125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:52.983474 13125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:52.984627 13125 hybrid_clock.cc:648] HybridClock initialized: now 1786178032984618 us; error 31 us; skew 500 ppm
Aug 08 08:33:52 dist-test-slave-zkpd krb5kdc[12728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:52.987316 13125 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:33:52.988255 13125 webserver.cc:460] Webserver started at http://127.25.170.3:37165/ using document root <none> and password file <none>
I20260808 08:33:52.988792 13125 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:52.988870 13125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:52.989108 13125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:52.991093 13125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "ac3497f7d2f7460bb580cb96fa8bf34e"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "e00d8eb3f40c971689785e32e8be6a74"
server_key_iv: "b060aad67fc4a48aa936ced1885c47d6"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.991662 13125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "ac3497f7d2f7460bb580cb96fa8bf34e"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "e00d8eb3f40c971689785e32e8be6a74"
server_key_iv: "b060aad67fc4a48aa936ced1885c47d6"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.995312 13125 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:33:52.997700 13140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:52.998881 13125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:52.999010 13125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "ac3497f7d2f7460bb580cb96fa8bf34e"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-zkpd"
server_key: "e00d8eb3f40c971689785e32e8be6a74"
server_key_iv: "b060aad67fc4a48aa936ced1885c47d6"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.999110 13125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:53.025310 13125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:53.028250 13125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:53.028403 13125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:53.028944 13125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:53.029721 13125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:53.029780 13125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:53.029829 13125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:53.029851 13125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:53.040259 13125 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:34823
I20260808 08:33:53.040298 13267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:34823 every 8 connection(s)
I20260808 08:33:53.041145 13125 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:53.043292 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 13125
I20260808 08:33:53.043447 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:53.043782 26280 external_mini_cluster.cc:1428] Setting key ca27a499de26bd3ca3527418c294405e
Aug 08 08:33:53 dist-test-slave-zkpd krb5kdc[12728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:53.054616 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.042949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:56285 (local address 127.25.170.62:45623)
0808 08:33:53.043127 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.043131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.044200 (+ 1069us) server_negotiation.cc:407] Connection header received
0808 08:33:53.045900 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.045906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.045967 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.046042 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:53.047174 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.047689 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.048776 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.048987 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.049067 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.051336 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:53.051339 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:53.051341 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:53.051363 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:53.052919 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:53.053374 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:53.053376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:53.053377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:53.053449 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:53.053745 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:53.053748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:53.053749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:53.053906 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:53.053978 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.054405 (+ 427us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.054503 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 08:33:53.055337 13270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.043456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:45623 (local address 127.25.170.3:56285)
0808 08:33:53.044024 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:53.044067 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:53.045667 (+ 1600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:53.046240 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:53.046247 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:53.046585 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:53.047049 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.047061 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.047790 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.047797 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.048672 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.048681 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.049111 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.049113 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.049253 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.049779 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:53.049795 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:53.051184 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:53.053024 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:53.053028 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:53.053039 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:53.053276 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:53.053526 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:53.053528 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:53.053529 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:53.053651 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:53.053990 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:53.053994 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:53.054195 (+ 201us) client_negotiation.cc:769] Sending connection context
0808 08:33:53.054349 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 08:33:53.054568 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":158,"threads_started":1}
I20260808 08:33:53.056631 13268 heartbeater.cc:347] Connected to a master server at 127.25.170.62:45623
I20260808 08:33:53.056908 13268 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:53.057435 13268 heartbeater.cc:511] Master 127.25.170.62:45623 requested a full tablet report, sending...
I20260808 08:33:53.058504 12777 ts_manager.cc:194] Registered new tserver with Master: ac3497f7d2f7460bb580cb96fa8bf34e (127.25.170.3:34823)
I20260808 08:33:53.059057 12777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:56285
I20260808 08:33:53.069535 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:33:53.078933 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.071475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45210 (local address 127.25.170.62:45623)
0808 08:33:53.071621 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.071626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.071869 (+ 243us) server_negotiation.cc:407] Connection header received
0808 08:33:53.072017 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.072019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.072070 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.072135 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:53.072787 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.073260 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.074079 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.074282 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.074367 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.075802 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:53.075805 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:53.075807 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:53.075830 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:53.077360 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:53.077781 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:53.077783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:53.077784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:53.077857 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:53.078120 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:53.078122 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:53.078123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:53.078308 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:53.078430 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.078643 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.078751 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:33:53.081730 12777 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45210:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:53.084815 12777 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:53.098946 13284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.093158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37806 (local address 127.25.170.3:34823)
0808 08:33:53.094105 (+ 947us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.094120 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.094147 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:33:53.094229 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.094237 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.094482 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.094653 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:53.094997 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.096171 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.097701 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.098253 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.098386 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.098537 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.098705 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.098798 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":825,"thread_start_us":151,"threads_started":1}
I20260808 08:33:53.098935 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.093000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:34823 (local address 127.0.0.1:37806)
0808 08:33:53.093375 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:53.093425 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:53.093626 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:53.094656 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:53.094664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:53.094690 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:53.094860 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.094869 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.096329 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.096333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.097587 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.097598 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.098385 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.098388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.098494 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.098529 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:33:53.098662 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 08:33:53.098784 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":52,"thread_start_us":86,"threads_started":1}
I20260808 08:33:53.099421 13286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.094026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:32893 (local address 127.0.0.1:33652)
0808 08:33:53.094442 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:53.094455 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:53.094541 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:53.095310 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:53.095313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:53.095332 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:53.095422 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.095428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.096469 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.096472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.097711 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.097721 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.099007 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.099011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.099101 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.099123 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:33:53.099199 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 08:33:53.099268 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":26,"thread_start_us":96,"threads_started":1}
I20260808 08:33:53.099810 13281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.093094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:43931 (local address 127.0.0.1:35488)
0808 08:33:53.094242 (+ 1148us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:53.094256 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:53.094368 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:53.095485 (+ 1117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:53.095489 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:53.095507 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:53.095598 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.095603 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.097165 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.097168 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.098297 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.098307 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.099385 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.099389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.099497 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.099522 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:33:53.099614 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:33:53.099679 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1082,"mutex_wait_us":24,"thread_start_us":79,"threads_started":1}
I20260808 08:33:53.099932 13287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.094214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33652 (local address 127.25.170.2:32893)
0808 08:33:53.094856 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.094869 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.094897 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:33:53.094981 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.094987 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.095168 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.095331 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:53.095506 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.096329 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.097861 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.098703 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.098800 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.098937 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.099627 (+ 690us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.099737 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":115,"threads_started":1}
I20260808 08:33:53.100351 13285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.093842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35488 (local address 127.25.170.1:43931)
0808 08:33:53.094996 (+ 1154us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.095013 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.095037 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:33:53.095114 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.095119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.095308 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.095745 (+ 437us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:53.095928 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.097009 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.098456 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.099254 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.099382 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.099540 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.100104 (+ 564us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.100209 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1036,"thread_start_us":115,"threads_started":1}
I20260808 08:33:53.102588 13193 tablet_service.cc:1467] Processing CreateTablet for tablet 77defce39a804e47b3803b41bbc64a2c (DEFAULT_TABLE table=test-table [id=c98e42d4d3ee4b65b0d2403090f2252c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:53.102932 12908 tablet_service.cc:1467] Processing CreateTablet for tablet 77defce39a804e47b3803b41bbc64a2c (DEFAULT_TABLE table=test-table [id=c98e42d4d3ee4b65b0d2403090f2252c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:53.102867 13052 tablet_service.cc:1467] Processing CreateTablet for tablet 77defce39a804e47b3803b41bbc64a2c (DEFAULT_TABLE table=test-table [id=c98e42d4d3ee4b65b0d2403090f2252c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:53.103819 13193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77defce39a804e47b3803b41bbc64a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:53.103953 13052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77defce39a804e47b3803b41bbc64a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:53.103953 12908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77defce39a804e47b3803b41bbc64a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:53.109956 13289 tablet_bootstrap.cc:492] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: Bootstrap starting.
I20260808 08:33:53.111220 13290 tablet_bootstrap.cc:492] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770: Bootstrap starting.
I20260808 08:33:53.112375 13291 tablet_bootstrap.cc:492] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: Bootstrap starting.
I20260808 08:33:53.112910 13289 tablet_bootstrap.cc:654] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:53.113476 13290 tablet_bootstrap.cc:654] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:53.114310 13289 log.cc:824] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:53.114575 13291 tablet_bootstrap.cc:654] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:53.114730 13290 log.cc:824] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:53.115408 13291 log.cc:824] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:53.116410 13289 tablet_bootstrap.cc:492] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: No bootstrap required, opened a new log
I20260808 08:33:53.116607 13289 ts_tablet_manager.cc:1397] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:33:53.116730 13290 tablet_bootstrap.cc:492] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770: No bootstrap required, opened a new log
I20260808 08:33:53.116907 13290 ts_tablet_manager.cc:1397] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:33:53.117344 13291 tablet_bootstrap.cc:492] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: No bootstrap required, opened a new log
I20260808 08:33:53.117544 13291 ts_tablet_manager.cc:1397] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 08:33:53.120306 13291 raft_consensus.cc:348] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 } } peers { permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 } } peers { permanent_uuid: "fdb2acfb94e34cf783e29260da95a122" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 32893 } }
I20260808 08:33:53.120551 13291 raft_consensus.cc:374] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:53.120609 13291 raft_consensus.cc:729] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb2acfb94e34cf783e29260da95a122, State: Initialized, Role: FOLLOWER
I20260808 08:33:53.120546 13290 raft_consensus.cc:348] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 } } peers { permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 } } peers { permanent_uuid: "fdb2acfb94e34cf783e29260da95a122" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 32893 } }
I20260808 08:33:53.120546 13289 raft_consensus.cc:348] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 } } peers { permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 } } peers { permanent_uuid: "fdb2acfb94e34cf783e29260da95a122" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 32893 } }
I20260808 08:33:53.120812 13289 raft_consensus.cc:374] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:53.120805 13290 raft_consensus.cc:374] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:53.120867 13289 raft_consensus.cc:729] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3497f7d2f7460bb580cb96fa8bf34e, State: Initialized, Role: FOLLOWER
I20260808 08:33:53.120934 13290 raft_consensus.cc:729] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a5e66a7e3e4192ad886c033c818770, State: Initialized, Role: FOLLOWER
I20260808 08:33:53.121145 13291 consensus_queue.cc:260] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 } } peers { permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 } } peers { permanent_uuid: "fdb2acfb94e34cf783e29260da95a122" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 32893 } }
I20260808 08:33:53.121317 13290 consensus_queue.cc:260] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 } } peers { permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 } } peers { permanent_uuid: "fdb2acfb94e34cf783e29260da95a122" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 32893 } }
I20260808 08:33:53.121299 13289 consensus_queue.cc:260] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 } } peers { permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 } } peers { permanent_uuid: "fdb2acfb94e34cf783e29260da95a122" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 32893 } }
I20260808 08:33:53.121862 13120 heartbeater.cc:503] Master 127.25.170.62:45623 was elected leader, sending a full tablet report...
I20260808 08:33:53.122152 13291 ts_tablet_manager.cc:1428] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:33:53.122225 13290 ts_tablet_manager.cc:1428] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 08:33:53.122225 13289 ts_tablet_manager.cc:1428] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:33:53.122576 13268 heartbeater.cc:503] Master 127.25.170.62:45623 was elected leader, sending a full tablet report...
I20260808 08:33:53.122767 12980 heartbeater.cc:503] Master 127.25.170.62:45623 was elected leader, sending a full tablet report...
I20260808 08:33:53.201499 13295 raft_consensus.cc:482] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:53.201836 13295 raft_consensus.cc:504] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 } } peers { permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 } } peers { permanent_uuid: "fdb2acfb94e34cf783e29260da95a122" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 32893 } }
I20260808 08:33:53.203119 13295 leader_election.cc:288] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac3497f7d2f7460bb580cb96fa8bf34e (127.25.170.3:34823), 36a5e66a7e3e4192ad886c033c818770 (127.25.170.1:43931)
I20260808 08:33:53.206990 13284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.203484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:59669 (local address 127.25.170.3:34823)
0808 08:33:53.203608 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.203613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.203632 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:33:53.203755 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.203758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.203801 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.203891 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:53.204259 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.204885 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.206000 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.206421 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.206553 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.206606 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.206799 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.206868 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:33:53.206990 13122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.203340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:34823 (local address 127.25.170.2:59669)
0808 08:33:53.203503 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:53.203520 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:53.203614 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:53.203963 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:53.203967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:53.203989 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:53.204119 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.204125 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.204996 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.205001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.205865 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.205874 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.206548 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.206552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.206659 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.206683 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:33:53.206780 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 08:33:53.206863 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 08:33:53.207372 13285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.203480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:39637 (local address 127.25.170.1:43931)
0808 08:33:53.203611 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.203616 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.204124 (+ 508us) server_negotiation.cc:407] Connection header received
0808 08:33:53.204260 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.204264 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.204325 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.204412 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:53.204708 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.205291 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.206388 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.206796 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.206927 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.206976 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.207181 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.207255 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 08:33:53.207731 13299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.203357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:43931 (local address 127.25.170.2:39637)
0808 08:33:53.204022 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:53.204039 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:53.204163 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:53.204424 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:53.204426 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:53.204444 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:53.204585 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.204591 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.205405 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.205410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.206255 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.206265 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.206918 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.206922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.207020 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.207044 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:33:53.207525 (+ 481us) client_negotiation.cc:240] Negotiation successful
0808 08:33:53.207600 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":173,"thread_start_us":178,"threads_started":1}
I20260808 08:33:53.207679 13217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77defce39a804e47b3803b41bbc64a2c" candidate_uuid: "fdb2acfb94e34cf783e29260da95a122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" is_pre_election: true
I20260808 08:33:53.208027 13217 raft_consensus.cc:2454] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdb2acfb94e34cf783e29260da95a122 in term 0.
I20260808 08:33:53.208468 12931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77defce39a804e47b3803b41bbc64a2c" candidate_uuid: "fdb2acfb94e34cf783e29260da95a122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a5e66a7e3e4192ad886c033c818770" is_pre_election: true
I20260808 08:33:53.208524 13003 leader_election.cc:302] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac3497f7d2f7460bb580cb96fa8bf34e, fdb2acfb94e34cf783e29260da95a122; no voters:
I20260808 08:33:53.208755 12931 raft_consensus.cc:2454] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdb2acfb94e34cf783e29260da95a122 in term 0.
I20260808 08:33:53.208787 13295 raft_consensus.cc:2781] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:53.208913 13295 raft_consensus.cc:482] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:53.208966 13295 raft_consensus.cc:3037] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:53.210093 13295 raft_consensus.cc:504] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 } } peers { permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 } } peers { permanent_uuid: "fdb2acfb94e34cf783e29260da95a122" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 32893 } }
I20260808 08:33:53.210440 13295 leader_election.cc:288] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [CANDIDATE]: Term 1 election: Requested vote from peers ac3497f7d2f7460bb580cb96fa8bf34e (127.25.170.3:34823), 36a5e66a7e3e4192ad886c033c818770 (127.25.170.1:43931)
I20260808 08:33:53.210752 13217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77defce39a804e47b3803b41bbc64a2c" candidate_uuid: "fdb2acfb94e34cf783e29260da95a122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e"
I20260808 08:33:53.210778 12931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77defce39a804e47b3803b41bbc64a2c" candidate_uuid: "fdb2acfb94e34cf783e29260da95a122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a5e66a7e3e4192ad886c033c818770"
I20260808 08:33:53.210865 13217 raft_consensus.cc:3037] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:53.210924 12931 raft_consensus.cc:3037] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:53.212076 13217 raft_consensus.cc:2454] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2acfb94e34cf783e29260da95a122 in term 1.
I20260808 08:33:53.212129 12931 raft_consensus.cc:2454] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdb2acfb94e34cf783e29260da95a122 in term 1.
I20260808 08:33:53.212373 13003 leader_election.cc:302] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac3497f7d2f7460bb580cb96fa8bf34e, fdb2acfb94e34cf783e29260da95a122; no voters:
I20260808 08:33:53.212556 13295 raft_consensus.cc:2781] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:53.212800 13295 raft_consensus.cc:686] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 1 LEADER]: Becoming Leader. State: Replica: fdb2acfb94e34cf783e29260da95a122, State: Running, Role: LEADER
I20260808 08:33:53.213141 13295 consensus_queue.cc:237] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 } } peers { permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 } } peers { permanent_uuid: "fdb2acfb94e34cf783e29260da95a122" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 32893 } }
I20260808 08:33:53.216378 12773 catalog_manager.cc:5495] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdb2acfb94e34cf783e29260da95a122 (127.25.170.2). New cstate: current_term: 1 leader_uuid: "fdb2acfb94e34cf783e29260da95a122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdb2acfb94e34cf783e29260da95a122" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 32893 } health_report { overall_health: HEALTHY } } }
I20260808 08:33:53.228590 13287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.225409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33656 (local address 127.25.170.2:32893)
0808 08:33:53.225528 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.225540 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.225553 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:33:53.225690 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.225692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.225740 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.225825 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:53.226046 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.226519 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.227282 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.227484 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.227556 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.227837 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:53.228215 (+ 378us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:53.228317 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.228450 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.228482 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:33:53.234200 12931 raft_consensus.cc:1261] T 77defce39a804e47b3803b41bbc64a2c P 36a5e66a7e3e4192ad886c033c818770 [term 1 FOLLOWER]: Refusing update from remote peer fdb2acfb94e34cf783e29260da95a122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:53.234200 13217 raft_consensus.cc:1261] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e [term 1 FOLLOWER]: Refusing update from remote peer fdb2acfb94e34cf783e29260da95a122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:53.234999 13302 consensus_queue.cc:1035] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a5e66a7e3e4192ad886c033c818770" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:53.235232 13295 consensus_queue.cc:1035] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac3497f7d2f7460bb580cb96fa8bf34e" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 34823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:53.246043 13307 mvcc.cc:205] Tried to move back new op lower bound from 7316185224119869440 to 7316185224043839488. Current Snapshot: MvccSnapshot[applied={T|T < 7316185224119869440}]
I20260808 08:33:53.253113 12777 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:53.253278 12777 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:53.255591 12777 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1736fbe0d31c4462a38c51c8b9f4ad6d: Sending DeleteTablet for 3 replicas of tablet 77defce39a804e47b3803b41bbc64a2c
I20260808 08:33:53.256361 13193 tablet_service.cc:1514] Processing DeleteTablet for tablet 77defce39a804e47b3803b41bbc64a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:53 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:37806
I20260808 08:33:53.256361 12908 tablet_service.cc:1514] Processing DeleteTablet for tablet 77defce39a804e47b3803b41bbc64a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:53 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:35488
I20260808 08:33:53.256565 13052 tablet_service.cc:1514] Processing DeleteTablet for tablet 77defce39a804e47b3803b41bbc64a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:53 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:33652
I20260808 08:33:53.256873 13317 tablet_replica.cc:330] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: stopping tablet replica
I20260808 08:33:53.257081 13318 tablet_replica.cc:330] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: stopping tablet replica
I20260808 08:33:53.257184 13317 raft_consensus.cc:2229] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:53.257345 13318 raft_consensus.cc:2229] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:53.257458 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 12841
I20260808 08:33:53.257470 13317 raft_consensus.cc:2258] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:53.257664 13318 raft_consensus.cc:2258] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:53.260630 13318 ts_tablet_manager.cc:1905] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:53.261142 13317 ts_tablet_manager.cc:1905] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:53.263545 13318 ts_tablet_manager.cc:1918] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:53.263670 13318 log.cc:1196] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/77defce39a804e47b3803b41bbc64a2c
I20260808 08:33:53.264070 13318 ts_tablet_manager.cc:1939] T 77defce39a804e47b3803b41bbc64a2c P fdb2acfb94e34cf783e29260da95a122: Deleting consensus metadata
I20260808 08:33:53.264537 13317 ts_tablet_manager.cc:1918] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:53.264652 13317 log.cc:1196] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/77defce39a804e47b3803b41bbc64a2c
I20260808 08:33:53.265110 13317 ts_tablet_manager.cc:1939] T 77defce39a804e47b3803b41bbc64a2c P ac3497f7d2f7460bb580cb96fa8bf34e: Deleting consensus metadata
I20260808 08:33:53.265389 12759 catalog_manager.cc:4841] TS fdb2acfb94e34cf783e29260da95a122 (127.25.170.2:32893): tablet 77defce39a804e47b3803b41bbc64a2c (table test-table [id=c98e42d4d3ee4b65b0d2403090f2252c]) successfully deleted
I20260808 08:33:53.266300 12761 catalog_manager.cc:4841] TS ac3497f7d2f7460bb580cb96fa8bf34e (127.25.170.3:34823): tablet 77defce39a804e47b3803b41bbc64a2c (table test-table [id=c98e42d4d3ee4b65b0d2403090f2252c]) successfully deleted
W20260808 08:33:53.269142 12759 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:43931 (error 108)
I20260808 08:33:53.270028 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 12985
I20260808 08:33:53.270203 13281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.269900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:43931 (local address 127.0.0.1:35500)
0808 08:33:53.270025 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:53.270103 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:43931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 08:33:53.271277 12759 catalog_manager.cc:4584] TS 36a5e66a7e3e4192ad886c033c818770 (127.25.170.1:43931): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 77defce39a804e47b3803b41bbc64a2c: Network error: Client connection negotiation failed: client connection to 127.25.170.1:43931: connect: Connection refused (error 111)
I20260808 08:33:53.277602 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 13125
I20260808 08:33:53.285012 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 12741
2026-08-08T08:33:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2371 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T08:33:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:53Z Disabled control of system clock
I20260808 08:33:53.317992 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:38525
--webserver_interface=127.25.170.62
--webserver_port=0
--builtin_ntp_servers=127.25.170.20:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:38525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:33:53.433182 13323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:53.433430 13323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:53.433471 13323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:53.437460 13323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:53.437510 13323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:53.437525 13323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:53.437541 13323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:53.437556 13323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:53.442251 13323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:38525
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:38525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:53.443280 13323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:53.444653 13323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:53.452936 13330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:53.452952 13329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:53.453326 13332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:53.453473 13323 server_base.cc:1034] running on GCE node
I20260808 08:33:53.454089 13323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:53.455197 13323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:53.456379 13323 hybrid_clock.cc:648] HybridClock initialized: now 1786178033456364 us; error 35 us; skew 500 ppm
I20260808 08:33:53.458211 13323 webserver.cc:460] Webserver started at http://127.25.170.62:32951/ using document root <none> and password file <none>
I20260808 08:33:53.458811 13323 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:53.458913 13323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:53.459204 13323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:53.462450 13323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "564c0b6e2630464c95042e00ef0d30e8"
format_stamp: "Formatted at 2026-08-08 08:33:53 on dist-test-slave-zkpd"
server_key: "4e3e962454fd09bbdd7f20b313eaa3d7"
server_key_iv: "549ddb5ac775175e68002a21c9fb8230"
server_key_version: "encryptionkey@0"
I20260808 08:33:53.463250 13323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "564c0b6e2630464c95042e00ef0d30e8"
format_stamp: "Formatted at 2026-08-08 08:33:53 on dist-test-slave-zkpd"
server_key: "4e3e962454fd09bbdd7f20b313eaa3d7"
server_key_iv: "549ddb5ac775175e68002a21c9fb8230"
server_key_version: "encryptionkey@0"
I20260808 08:33:53.467527 13323 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:33:53.470038 13338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:53.471285 13323 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:53.471431 13323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "564c0b6e2630464c95042e00ef0d30e8"
format_stamp: "Formatted at 2026-08-08 08:33:53 on dist-test-slave-zkpd"
server_key: "4e3e962454fd09bbdd7f20b313eaa3d7"
server_key_iv: "549ddb5ac775175e68002a21c9fb8230"
server_key_version: "encryptionkey@0"
I20260808 08:33:53.471544 13323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:53.481799 13323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:53.482445 13323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:53.482637 13323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:53.489686 13323 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:38525
I20260808 08:33:53.489706 13394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:38525 every 8 connection(s)
I20260808 08:33:53.490605 13323 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:53.493763 13395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:53.494028 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 13323
I20260808 08:33:53.494169 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:33:53.494457 26280 external_mini_cluster.cc:1428] Setting key 6414bc0e7ed72391f7550a9939c089fd
I20260808 08:33:53.500339 13395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8: Bootstrap starting.
I20260808 08:33:53.502650 13395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:53.503412 13395 log.cc:824] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:53.503737 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.495867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48902 (local address 127.25.170.62:38525)
0808 08:33:53.496537 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.496552 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.496587 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:33:53.497248 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.497266 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.497650 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.497986 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:53.498413 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.499378 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.500342 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.500872 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.501044 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.501967 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:53.501972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:53.501985 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:53.502354 (+ 369us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:53.502410 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:53.502430 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:53.502543 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.502702 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.502999 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":147,"threads_started":1}
I20260808 08:33:53.505336 13395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8: No bootstrap required, opened a new log
I20260808 08:33:53.508755 13395 raft_consensus.cc:348] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564c0b6e2630464c95042e00ef0d30e8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38525 } }
I20260808 08:33:53.508953 13395 raft_consensus.cc:374] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:53.509039 13395 raft_consensus.cc:729] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 564c0b6e2630464c95042e00ef0d30e8, State: Initialized, Role: FOLLOWER
I20260808 08:33:53.509492 13395 consensus_queue.cc:260] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564c0b6e2630464c95042e00ef0d30e8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38525 } }
I20260808 08:33:53.509672 13395 raft_consensus.cc:388] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:53.509742 13395 raft_consensus.cc:482] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:53.509843 13395 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:53.510707 13395 raft_consensus.cc:504] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564c0b6e2630464c95042e00ef0d30e8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38525 } }
I20260808 08:33:53.510986 13395 leader_election.cc:302] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 564c0b6e2630464c95042e00ef0d30e8; no voters:
I20260808 08:33:53.511219 13395 leader_election.cc:288] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:53.511346 13400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:53.511574 13400 raft_consensus.cc:686] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [term 1 LEADER]: Becoming Leader. State: Replica: 564c0b6e2630464c95042e00ef0d30e8, State: Running, Role: LEADER
I20260808 08:33:53.511873 13400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564c0b6e2630464c95042e00ef0d30e8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38525 } }
I20260808 08:33:53.512470 13395 sys_catalog.cc:564] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:53.513581 13401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "564c0b6e2630464c95042e00ef0d30e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564c0b6e2630464c95042e00ef0d30e8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38525 } } }
I20260808 08:33:53.513721 13401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:53.514014 13402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 564c0b6e2630464c95042e00ef0d30e8. Latest consensus state: current_term: 1 leader_uuid: "564c0b6e2630464c95042e00ef0d30e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564c0b6e2630464c95042e00ef0d30e8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 38525 } } }
I20260808 08:33:53.514129 13402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:53.514238 13409 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:53.517125 13409 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:53.522176 13409 catalog_manager.cc:1347] Generated new cluster ID: 34ba61382cd14c87b341ce78db88bb1e
I20260808 08:33:53.522258 13409 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:53.546098 13409 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:53.547399 13409 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:53.558449 13409 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8: Generated new TSK 0
I20260808 08:33:53.559310 13409 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:33:53.569799 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38525
--builtin_ntp_servers=127.25.170.20:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:33:53.684620 13420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:53.684857 13420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:53.684894 13420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:53.688851 13420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:53.688897 13420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:53.688947 13420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:33:53.693497 13420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:53.694466 13420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:53.695725 13420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:53.705122 13426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:53.705233 13420 server_base.cc:1034] running on GCE node
W20260808 08:33:53.705132 13425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:53.705375 13428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:53.705741 13420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:53.706341 13420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:53.707520 13420 hybrid_clock.cc:648] HybridClock initialized: now 1786178033707488 us; error 42 us; skew 500 ppm
I20260808 08:33:53.709332 13420 webserver.cc:460] Webserver started at http://127.25.170.1:40465/ using document root <none> and password file <none>
I20260808 08:33:53.709887 13420 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:53.709976 13420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:53.710203 13420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:53.712219 13420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "efaf7c55e19d4a969d205824e5bd35ab"
format_stamp: "Formatted at 2026-08-08 08:33:53 on dist-test-slave-zkpd"
server_key: "349aa19cd498c731f596025b2be4f9a6"
server_key_iv: "284908913e669b7f57c776d4ab40dc36"
server_key_version: "encryptionkey@0"
I20260808 08:33:53.712780 13420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "efaf7c55e19d4a969d205824e5bd35ab"
format_stamp: "Formatted at 2026-08-08 08:33:53 on dist-test-slave-zkpd"
server_key: "349aa19cd498c731f596025b2be4f9a6"
server_key_iv: "284908913e669b7f57c776d4ab40dc36"
server_key_version: "encryptionkey@0"
I20260808 08:33:53.716450 13420 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:53.718677 13434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:53.719826 13420 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:53.719982 13420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "efaf7c55e19d4a969d205824e5bd35ab"
format_stamp: "Formatted at 2026-08-08 08:33:53 on dist-test-slave-zkpd"
server_key: "349aa19cd498c731f596025b2be4f9a6"
server_key_iv: "284908913e669b7f57c776d4ab40dc36"
server_key_version: "encryptionkey@0"
I20260808 08:33:53.720088 13420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:53.750422 13420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:53.751163 13420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:53.751366 13420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:53.752068 13420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:53.753031 13420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:53.753077 13420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:53.753147 13420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:53.753189 13420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:53.762404 13420 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:33873
I20260808 08:33:53.762442 13551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:33873 every 8 connection(s)
I20260808 08:33:53.763266 13420 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:53.767117 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 13420
I20260808 08:33:53.767262 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:53.767562 26280 external_mini_cluster.cc:1428] Setting key 1eb08bb6feb2ed1bdfbc287101ced38c
I20260808 08:33:53.769695 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38525
--builtin_ntp_servers=127.25.170.20:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:33:53.773455 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.765114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:44823 (local address 127.25.170.62:38525)
0808 08:33:53.765254 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.765265 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.766361 (+ 1096us) server_negotiation.cc:407] Connection header received
0808 08:33:53.767847 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.767851 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.767943 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.768048 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:53.769135 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.769936 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.771123 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.771510 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.771605 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.772996 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:53.773000 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:53.773002 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:53.773013 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:53.773033 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:53.773041 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:53.773100 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.773290 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.773344 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:33:53.774725 13554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.765539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38525 (local address 127.25.170.1:44823)
0808 08:33:53.766210 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:53.766251 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:53.767568 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:53.768241 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:53.768250 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:53.768390 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:53.768973 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.768995 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.770071 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.770074 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.770984 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.770995 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.771693 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.771700 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.771956 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.772682 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:33:53.772685 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:53.772742 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:33:53.772830 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:53.773131 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:53.773143 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:53.773152 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:33:53.773281 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 08:33:53.773591 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":121,"threads_started":1}
I20260808 08:33:53.776150 13552 heartbeater.cc:347] Connected to a master server at 127.25.170.62:38525
I20260808 08:33:53.776418 13552 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:53.777127 13552 heartbeater.cc:511] Master 127.25.170.62:38525 requested a full tablet report, sending...
I20260808 08:33:53.778918 13355 ts_manager.cc:194] Registered new tserver with Master: efaf7c55e19d4a969d205824e5bd35ab (127.25.170.1:33873)
I20260808 08:33:53.780669 13355 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.1:44823
W20260808 08:33:53.884783 13555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:53.885005 13555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:53.885041 13555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:53.888856 13555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:53.888897 13555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:53.888947 13555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:33:53.893394 13555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:53.894315 13555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:53.895551 13555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:53.904872 13560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:53.904887 13563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:53.904887 13561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:53.905087 13555 server_base.cc:1034] running on GCE node
I20260808 08:33:53.905550 13555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:53.906155 13555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:53.907354 13555 hybrid_clock.cc:648] HybridClock initialized: now 1786178033907341 us; error 26 us; skew 500 ppm
I20260808 08:33:53.909144 13555 webserver.cc:460] Webserver started at http://127.25.170.2:33177/ using document root <none> and password file <none>
I20260808 08:33:53.909719 13555 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:53.909811 13555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:53.910039 13555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:53.912088 13555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "182ae7dace2b45d3888d24b720afe835"
format_stamp: "Formatted at 2026-08-08 08:33:53 on dist-test-slave-zkpd"
server_key: "28d495ccb1edbae36e0143d08027cae0"
server_key_iv: "8e144e03bc91d0f9574ae5e1f79599eb"
server_key_version: "encryptionkey@0"
I20260808 08:33:53.912712 13555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "182ae7dace2b45d3888d24b720afe835"
format_stamp: "Formatted at 2026-08-08 08:33:53 on dist-test-slave-zkpd"
server_key: "28d495ccb1edbae36e0143d08027cae0"
server_key_iv: "8e144e03bc91d0f9574ae5e1f79599eb"
server_key_version: "encryptionkey@0"
I20260808 08:33:53.916452 13555 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:33:53.918862 13570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:53.920076 13555 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:53.920205 13555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "182ae7dace2b45d3888d24b720afe835"
format_stamp: "Formatted at 2026-08-08 08:33:53 on dist-test-slave-zkpd"
server_key: "28d495ccb1edbae36e0143d08027cae0"
server_key_iv: "8e144e03bc91d0f9574ae5e1f79599eb"
server_key_version: "encryptionkey@0"
I20260808 08:33:53.920315 13555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:53.932435 13555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:53.933061 13555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:53.933255 13555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:53.933856 13555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:53.934788 13555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:53.934863 13555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:53.934934 13555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:53.934979 13555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:53.943957 13555 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:41709
I20260808 08:33:53.943997 13687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:41709 every 8 connection(s)
I20260808 08:33:53.944816 13555 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:53.947860 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 13555
I20260808 08:33:53.948028 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:53.948360 26280 external_mini_cluster.cc:1428] Setting key 02febfe69bc790c9442b69faaa0de0ca
I20260808 08:33:53.950526 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38525
--builtin_ntp_servers=127.25.170.20:45253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:33:53.954876 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.946580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:37563 (local address 127.25.170.62:38525)
0808 08:33:53.946732 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:53.946737 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:53.947934 (+ 1197us) server_negotiation.cc:407] Connection header received
0808 08:33:53.949722 (+ 1788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:53.949728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:53.949788 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:53.949879 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:53.950858 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.951683 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.952917 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.953142 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.953257 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.954375 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:53.954379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:53.954381 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:53.954401 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:53.954421 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:53.954429 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:53.954506 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:53.954665 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 08:33:53.954727 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:33:53.955789 13691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:53.947015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38525 (local address 127.25.170.2:37563)
0808 08:33:53.947710 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:53.947768 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:53.949479 (+ 1711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:53.950083 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:53.950090 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:53.950174 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:53.950693 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.950713 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.951817 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.951820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.952788 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:53.952799 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:53.953308 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:53.953313 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:53.953478 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:53.954112 (+ 634us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:33:53.954114 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:53.954153 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:33:53.954214 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:53.954522 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:53.954538 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:53.954543 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:33:53.954664 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 08:33:53.954938 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":107,"threads_started":1}
I20260808 08:33:53.956951 13688 heartbeater.cc:347] Connected to a master server at 127.25.170.62:38525
I20260808 08:33:53.957223 13688 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:53.957897 13688 heartbeater.cc:511] Master 127.25.170.62:38525 requested a full tablet report, sending...
I20260808 08:33:53.959065 13355 ts_manager.cc:194] Registered new tserver with Master: 182ae7dace2b45d3888d24b720afe835 (127.25.170.2:41709)
I20260808 08:33:53.959619 13355 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.2:37563
W20260808 08:33:54.066341 13692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:54.066589 13692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:54.066627 13692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:54.070713 13692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:54.070787 13692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:54.070874 13692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:33:54.075704 13692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:45253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:38525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:54.076793 13692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:54.078186 13692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:54.087267 13697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:54.087278 13698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:54.087281 13700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:54.087599 13692 server_base.cc:1034] running on GCE node
I20260808 08:33:54.088033 13692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:54.088629 13692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:54.089812 13692 hybrid_clock.cc:648] HybridClock initialized: now 1786178034089788 us; error 44 us; skew 500 ppm
I20260808 08:33:54.091565 13692 webserver.cc:460] Webserver started at http://127.25.170.3:37241/ using document root <none> and password file <none>
I20260808 08:33:54.092242 13692 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:54.092340 13692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:54.092571 13692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:54.094574 13692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "bb183bd0a3fa4fdd9840ea34d57f3401"
format_stamp: "Formatted at 2026-08-08 08:33:54 on dist-test-slave-zkpd"
server_key: "619e4b911ae4b9be652b85f351a3ac64"
server_key_iv: "fef19b8adf9dc5b92b5c74ed76c92638"
server_key_version: "encryptionkey@0"
I20260808 08:33:54.095136 13692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "bb183bd0a3fa4fdd9840ea34d57f3401"
format_stamp: "Formatted at 2026-08-08 08:33:54 on dist-test-slave-zkpd"
server_key: "619e4b911ae4b9be652b85f351a3ac64"
server_key_iv: "fef19b8adf9dc5b92b5c74ed76c92638"
server_key_version: "encryptionkey@0"
I20260808 08:33:54.098783 13692 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.002s
I20260808 08:33:54.101229 13706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:54.102771 13692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:33:54.102885 13692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "bb183bd0a3fa4fdd9840ea34d57f3401"
format_stamp: "Formatted at 2026-08-08 08:33:54 on dist-test-slave-zkpd"
server_key: "619e4b911ae4b9be652b85f351a3ac64"
server_key_iv: "fef19b8adf9dc5b92b5c74ed76c92638"
server_key_version: "encryptionkey@0"
I20260808 08:33:54.102970 13692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:54.114717 13692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:54.115356 13692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:54.115548 13692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:54.116178 13692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:54.117096 13692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:54.117143 13692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:54.117208 13692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:54.117246 13692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:54.126097 13692 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:44599
I20260808 08:33:54.126129 13823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:44599 every 8 connection(s)
I20260808 08:33:54.126930 13692 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:54.127580 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 13692
I20260808 08:33:54.127681 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:54.128131 26280 external_mini_cluster.cc:1428] Setting key 4bb461bb30ce93944f01afd97b89864e
I20260808 08:33:54.136279 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.128840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:49653 (local address 127.25.170.62:38525)
0808 08:33:54.128964 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:54.128969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:54.130672 (+ 1703us) server_negotiation.cc:407] Connection header received
0808 08:33:54.132016 (+ 1344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:54.132018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:54.132061 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:54.132131 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:54.132933 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.133443 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.134557 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.134763 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.134847 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.135818 (+ 971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:54.135829 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:54.135831 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:54.135843 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:54.135862 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:54.135870 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:54.135986 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:54.136118 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 08:33:54.136169 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 08:33:54.137070 13827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.129359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:38525 (local address 127.25.170.3:49653)
0808 08:33:54.130550 (+ 1191us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:54.130589 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:54.131815 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:54.132258 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:54.132264 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:54.132344 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:54.132816 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.132829 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.133558 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.133560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.134452 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.134462 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.134899 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.134901 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.135038 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.135584 (+ 546us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:33:54.135586 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:54.135623 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:33:54.135682 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:54.135992 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:54.135999 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:54.136004 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:33:54.136101 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 08:33:54.136307 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"thread_start_us":116,"threads_started":1}
I20260808 08:33:54.138121 13824 heartbeater.cc:347] Connected to a master server at 127.25.170.62:38525
I20260808 08:33:54.138355 13824 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:54.138849 13824 heartbeater.cc:511] Master 127.25.170.62:38525 requested a full tablet report, sending...
I20260808 08:33:54.139820 13355 ts_manager.cc:194] Registered new tserver with Master: bb183bd0a3fa4fdd9840ea34d57f3401 (127.25.170.3:44599)
I20260808 08:33:54.140377 13355 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.3:49653
I20260808 08:33:54.142017 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:33:54.147362 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.143993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48904 (local address 127.25.170.62:38525)
0808 08:33:54.144100 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:54.144104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:54.144316 (+ 212us) server_negotiation.cc:407] Connection header received
0808 08:33:54.144412 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:54.144414 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:54.144446 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:54.144509 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:54.144750 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.145211 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.145985 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.146178 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.146248 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.146960 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:54.146963 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:54.146965 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:54.146976 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:54.146992 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:54.146999 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:54.147099 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:54.147235 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 08:33:54.147266 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 08:33:54.149971 13355 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48904:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:54.152808 13355 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:54.166958 13836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.161185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:33873 (local address 127.0.0.1:44588)
0808 08:33:54.161764 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:54.161781 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:54.161904 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:54.162858 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:54.162864 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:54.162886 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:54.163036 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.163044 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.164179 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.164182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.165352 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.165361 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.166412 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.166415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.166523 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.166578 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 08:33:54.166684 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:33:54.166811 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":103,"threads_started":1}
I20260808 08:33:54.167122 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.160994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:44599 (local address 127.0.0.1:57762)
0808 08:33:54.161546 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:54.161591 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:54.162059 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:54.163049 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:54.163052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:54.163077 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:54.163186 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.163192 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.164692 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.164696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.165648 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.165658 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.166682 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.166688 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.166780 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.166804 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:33:54.166866 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 08:33:54.166932 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":11,"spinlock_wait_cycles":6656,"thread_start_us":121,"threads_started":1}
I20260808 08:33:54.167541 13840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.161714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44588 (local address 127.25.170.1:33873)
0808 08:33:54.162334 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:54.162347 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:54.162374 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:33:54.162460 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:54.162465 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:54.162671 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:54.162825 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:54.163169 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.164061 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.165471 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.166271 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.166393 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.166576 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:54.167285 (+ 709us) server_negotiation.cc:299] Negotiation successful
0808 08:33:54.167387 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":103,"threads_started":1}
I20260808 08:33:54.168270 13841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.161729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:41709 (local address 127.0.0.1:37286)
0808 08:33:54.162265 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:54.162281 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:54.162369 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:54.163042 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:54.163045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:54.163072 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:54.163251 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.163258 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.164692 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.164696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.166576 (+ 1880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.166588 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.167659 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.167663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.167744 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.167765 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 08:33:54.168056 (+ 291us) client_negotiation.cc:240] Negotiation successful
0808 08:33:54.168132 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":859,"spinlock_wait_cycles":8832,"thread_start_us":104,"threads_started":1}
I20260808 08:33:54.168334 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.162156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37286 (local address 127.25.170.2:41709)
0808 08:33:54.162577 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:54.162587 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:54.162607 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:33:54.162678 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:54.162684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:54.162879 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:54.163186 (+ 307us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:54.163350 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.164557 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.166734 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.167530 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.167656 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.167840 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:54.168083 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 08:33:54.168173 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":123,"threads_started":1}
I20260808 08:33:54.169538 13839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.161173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57762 (local address 127.25.170.3:44599)
0808 08:33:54.162603 (+ 1430us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:54.162612 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:54.162630 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:33:54.162693 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:54.162697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:54.162908 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:54.163059 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:54.163330 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.164554 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.165855 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.166525 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.166683 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.166859 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:54.166910 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 08:33:54.167011 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1345,"thread_start_us":160,"threads_started":1}
I20260808 08:33:54.170527 13484 tablet_service.cc:1467] Processing CreateTablet for tablet 2ecdd08c4b214f7e9a1e357bac491858 (DEFAULT_TABLE table=test-table [id=5675cd796af748359eb5c95d745f3ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:54.170953 13619 tablet_service.cc:1467] Processing CreateTablet for tablet 2ecdd08c4b214f7e9a1e357bac491858 (DEFAULT_TABLE table=test-table [id=5675cd796af748359eb5c95d745f3ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:54.171700 13484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ecdd08c4b214f7e9a1e357bac491858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:54.172025 13619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ecdd08c4b214f7e9a1e357bac491858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:54.172168 13756 tablet_service.cc:1467] Processing CreateTablet for tablet 2ecdd08c4b214f7e9a1e357bac491858 (DEFAULT_TABLE table=test-table [id=5675cd796af748359eb5c95d745f3ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:54.173141 13756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ecdd08c4b214f7e9a1e357bac491858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:54.178257 13843 tablet_bootstrap.cc:492] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: Bootstrap starting.
I20260808 08:33:54.179646 13844 tablet_bootstrap.cc:492] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab: Bootstrap starting.
I20260808 08:33:54.180164 13845 tablet_bootstrap.cc:492] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: Bootstrap starting.
I20260808 08:33:54.181596 13844 tablet_bootstrap.cc:654] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:54.181658 13843 tablet_bootstrap.cc:654] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:54.182124 13845 tablet_bootstrap.cc:654] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:54.182386 13844 log.cc:824] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:54.182507 13843 log.cc:824] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:54.182915 13845 log.cc:824] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:54.184433 13843 tablet_bootstrap.cc:492] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: No bootstrap required, opened a new log
I20260808 08:33:54.184525 13844 tablet_bootstrap.cc:492] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab: No bootstrap required, opened a new log
I20260808 08:33:54.184670 13843 ts_tablet_manager.cc:1397] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 08:33:54.184710 13844 ts_tablet_manager.cc:1397] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:33:54.184749 13845 tablet_bootstrap.cc:492] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: No bootstrap required, opened a new log
I20260808 08:33:54.184897 13845 ts_tablet_manager.cc:1397] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:33:54.188007 13843 raft_consensus.cc:348] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 } } peers { permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 } } peers { permanent_uuid: "182ae7dace2b45d3888d24b720afe835" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41709 } }
I20260808 08:33:54.188277 13843 raft_consensus.cc:374] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:54.188355 13843 raft_consensus.cc:729] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 182ae7dace2b45d3888d24b720afe835, State: Initialized, Role: FOLLOWER
I20260808 08:33:54.188840 13843 consensus_queue.cc:260] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 } } peers { permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 } } peers { permanent_uuid: "182ae7dace2b45d3888d24b720afe835" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41709 } }
I20260808 08:33:54.189034 13845 raft_consensus.cc:348] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 } } peers { permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 } } peers { permanent_uuid: "182ae7dace2b45d3888d24b720afe835" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41709 } }
I20260808 08:33:54.189034 13844 raft_consensus.cc:348] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 } } peers { permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 } } peers { permanent_uuid: "182ae7dace2b45d3888d24b720afe835" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41709 } }
I20260808 08:33:54.189282 13844 raft_consensus.cc:374] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:54.189282 13845 raft_consensus.cc:374] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:54.189353 13845 raft_consensus.cc:729] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb183bd0a3fa4fdd9840ea34d57f3401, State: Initialized, Role: FOLLOWER
I20260808 08:33:54.189354 13844 raft_consensus.cc:729] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efaf7c55e19d4a969d205824e5bd35ab, State: Initialized, Role: FOLLOWER
I20260808 08:33:54.189644 13688 heartbeater.cc:503] Master 127.25.170.62:38525 was elected leader, sending a full tablet report...
I20260808 08:33:54.189772 13845 consensus_queue.cc:260] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 } } peers { permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 } } peers { permanent_uuid: "182ae7dace2b45d3888d24b720afe835" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41709 } }
I20260808 08:33:54.189873 13843 ts_tablet_manager.cc:1428] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 08:33:54.189772 13844 consensus_queue.cc:260] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 } } peers { permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 } } peers { permanent_uuid: "182ae7dace2b45d3888d24b720afe835" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41709 } }
I20260808 08:33:54.190711 13845 ts_tablet_manager.cc:1428] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:33:54.190711 13844 ts_tablet_manager.cc:1428] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 08:33:54.190788 13552 heartbeater.cc:503] Master 127.25.170.62:38525 was elected leader, sending a full tablet report...
I20260808 08:33:54.191131 13824 heartbeater.cc:503] Master 127.25.170.62:38525 was elected leader, sending a full tablet report...
W20260808 08:33:54.195698 13690 tablet.cc:2369] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:54.200932 13849 raft_consensus.cc:482] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:54.201078 13849 raft_consensus.cc:504] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 } } peers { permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 } } peers { permanent_uuid: "182ae7dace2b45d3888d24b720afe835" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41709 } }
I20260808 08:33:54.202065 13849 leader_election.cc:288] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb183bd0a3fa4fdd9840ea34d57f3401 (127.25.170.3:44599), efaf7c55e19d4a969d205824e5bd35ab (127.25.170.1:33873)
I20260808 08:33:54.206637 13839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.202287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:33855 (local address 127.25.170.3:44599)
0808 08:33:54.202416 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:54.202420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:54.202442 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:33:54.202629 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:54.202632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:54.202685 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:54.202762 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:54.203070 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.203770 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.205372 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.205977 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.206114 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.206152 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:54.206450 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 08:33:54.206520 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:33:54.206642 13691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.202255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:44599 (local address 127.25.170.2:33855)
0808 08:33:54.202387 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:54.202403 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:54.202490 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:54.202796 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:54.202799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:54.202821 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:54.202953 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.202966 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.203877 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.203882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.205220 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.205233 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.206114 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.206117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.206276 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.206303 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 08:33:54.206376 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 08:33:54.206476 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":77}
I20260808 08:33:54.206674 13840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.202458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:34673 (local address 127.25.170.1:33873)
0808 08:33:54.202569 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:54.202573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:54.202762 (+ 189us) server_negotiation.cc:407] Connection header received
0808 08:33:54.202851 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:54.202854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:54.202899 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:54.202985 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:54.203278 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.204017 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.205372 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.205977 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.206100 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.206152 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:54.206482 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 08:33:54.206567 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 08:33:54.206655 13852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.202284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:33873 (local address 127.25.170.2:34673)
0808 08:33:54.202655 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:54.202668 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:54.202763 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:54.203002 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:54.203004 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:54.203040 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:54.203168 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.203174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.204121 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.204124 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.205253 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:54.205263 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.206105 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.206108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:54.206290 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.206320 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 08:33:54.206428 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 08:33:54.206503 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"mutex_wait_us":144,"thread_start_us":117,"threads_started":1}
I20260808 08:33:54.207448 13504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ecdd08c4b214f7e9a1e357bac491858" candidate_uuid: "182ae7dace2b45d3888d24b720afe835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaf7c55e19d4a969d205824e5bd35ab" is_pre_election: true
I20260808 08:33:54.207437 13777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ecdd08c4b214f7e9a1e357bac491858" candidate_uuid: "182ae7dace2b45d3888d24b720afe835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" is_pre_election: true
I20260808 08:33:54.207723 13504 raft_consensus.cc:2454] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 182ae7dace2b45d3888d24b720afe835 in term 0.
I20260808 08:33:54.207737 13777 raft_consensus.cc:2454] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 182ae7dace2b45d3888d24b720afe835 in term 0.
I20260808 08:33:54.208313 13573 leader_election.cc:302] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 182ae7dace2b45d3888d24b720afe835, bb183bd0a3fa4fdd9840ea34d57f3401, efaf7c55e19d4a969d205824e5bd35ab; no voters:
I20260808 08:33:54.208571 13849 raft_consensus.cc:2781] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:54.208643 13849 raft_consensus.cc:482] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:54.208673 13849 raft_consensus.cc:3037] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:54.209774 13849 raft_consensus.cc:504] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 } } peers { permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 } } peers { permanent_uuid: "182ae7dace2b45d3888d24b720afe835" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41709 } }
I20260808 08:33:54.210134 13849 leader_election.cc:288] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [CANDIDATE]: Term 1 election: Requested vote from peers bb183bd0a3fa4fdd9840ea34d57f3401 (127.25.170.3:44599), efaf7c55e19d4a969d205824e5bd35ab (127.25.170.1:33873)
I20260808 08:33:54.210453 13504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ecdd08c4b214f7e9a1e357bac491858" candidate_uuid: "182ae7dace2b45d3888d24b720afe835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaf7c55e19d4a969d205824e5bd35ab"
I20260808 08:33:54.210460 13777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ecdd08c4b214f7e9a1e357bac491858" candidate_uuid: "182ae7dace2b45d3888d24b720afe835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401"
I20260808 08:33:54.210583 13777 raft_consensus.cc:3037] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:54.210556 13504 raft_consensus.cc:3037] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:54.211592 13504 raft_consensus.cc:2454] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 182ae7dace2b45d3888d24b720afe835 in term 1.
I20260808 08:33:54.211596 13777 raft_consensus.cc:2454] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 182ae7dace2b45d3888d24b720afe835 in term 1.
I20260808 08:33:54.211905 13573 leader_election.cc:302] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 182ae7dace2b45d3888d24b720afe835, bb183bd0a3fa4fdd9840ea34d57f3401, efaf7c55e19d4a969d205824e5bd35ab; no voters:
I20260808 08:33:54.212106 13849 raft_consensus.cc:2781] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:54.212339 13849 raft_consensus.cc:686] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 1 LEADER]: Becoming Leader. State: Replica: 182ae7dace2b45d3888d24b720afe835, State: Running, Role: LEADER
I20260808 08:33:54.212641 13849 consensus_queue.cc:237] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 } } peers { permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 } } peers { permanent_uuid: "182ae7dace2b45d3888d24b720afe835" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41709 } }
I20260808 08:33:54.215682 13353 catalog_manager.cc:5495] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 reported cstate change: term changed from 0 to 1, leader changed from <none> to 182ae7dace2b45d3888d24b720afe835 (127.25.170.2). New cstate: current_term: 1 leader_uuid: "182ae7dace2b45d3888d24b720afe835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "182ae7dace2b45d3888d24b720afe835" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41709 } health_report { overall_health: HEALTHY } } }
I20260808 08:33:54.234230 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.230917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37296 (local address 127.25.170.2:41709)
0808 08:33:54.231043 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:54.231046 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:54.231060 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:33:54.231202 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:54.231204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:54.231255 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:54.231342 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:54.231540 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.232074 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.232914 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.233125 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.233207 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.233467 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:54.233879 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:54.233991 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:54.234074 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 08:33:54.234105 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:33:54.239945 13777 raft_consensus.cc:1261] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401 [term 1 FOLLOWER]: Refusing update from remote peer 182ae7dace2b45d3888d24b720afe835: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:54.239969 13504 raft_consensus.cc:1261] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab [term 1 FOLLOWER]: Refusing update from remote peer 182ae7dace2b45d3888d24b720afe835: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:54.240692 13853 consensus_queue.cc:1035] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efaf7c55e19d4a969d205824e5bd35ab" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 33873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:54.240873 13849 consensus_queue.cc:1035] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb183bd0a3fa4fdd9840ea34d57f3401" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 44599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:54.249137 13858 mvcc.cc:205] Tried to move back new op lower bound from 7316185228239806464 to 7316185228137512960. Current Snapshot: MvccSnapshot[applied={T|T < 7316185228239806464}]
I20260808 08:33:54.256839 13355 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:54.257005 13355 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:54.259491 13355 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 564c0b6e2630464c95042e00ef0d30e8: Sending DeleteTablet for 3 replicas of tablet 2ecdd08c4b214f7e9a1e357bac491858
I20260808 08:33:54.260378 13484 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ecdd08c4b214f7e9a1e357bac491858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:54 UTC) from {username='slave'} at 127.0.0.1:44588
I20260808 08:33:54.260560 13756 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ecdd08c4b214f7e9a1e357bac491858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:54 UTC) from {username='slave'} at 127.0.0.1:57762
I20260808 08:33:54.260874 13619 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ecdd08c4b214f7e9a1e357bac491858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:54 UTC) from {username='slave'} at 127.0.0.1:37286
I20260808 08:33:54.261083 13865 tablet_replica.cc:330] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab: stopping tablet replica
I20260808 08:33:54.261117 13866 tablet_replica.cc:330] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: stopping tablet replica
I20260808 08:33:54.261421 13865 raft_consensus.cc:2229] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:54.261570 13866 raft_consensus.cc:2229] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:54.261744 13865 raft_consensus.cc:2258] T 2ecdd08c4b214f7e9a1e357bac491858 P efaf7c55e19d4a969d205824e5bd35ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:54.261771 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 13420
I20260808 08:33:54.263581 13866 raft_consensus.cc:2258] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:54.264758 13867 tablet_replica.cc:330] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: stopping tablet replica
I20260808 08:33:54.265050 13867 raft_consensus.cc:2229] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:54.265429 13867 raft_consensus.cc:2258] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:54.265749 13866 ts_tablet_manager.cc:1905] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:54.266940 13867 ts_tablet_manager.cc:1905] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:54.269471 13866 ts_tablet_manager.cc:1918] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:54.269647 13866 log.cc:1196] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/2ecdd08c4b214f7e9a1e357bac491858
I20260808 08:33:54.269773 13867 ts_tablet_manager.cc:1918] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:54.269886 13867 log.cc:1196] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/2ecdd08c4b214f7e9a1e357bac491858
I20260808 08:33:54.270187 13866 ts_tablet_manager.cc:1939] T 2ecdd08c4b214f7e9a1e357bac491858 P bb183bd0a3fa4fdd9840ea34d57f3401: Deleting consensus metadata
I20260808 08:33:54.270201 13867 ts_tablet_manager.cc:1939] T 2ecdd08c4b214f7e9a1e357bac491858 P 182ae7dace2b45d3888d24b720afe835: Deleting consensus metadata
I20260808 08:33:54.271337 13340 catalog_manager.cc:4841] TS 182ae7dace2b45d3888d24b720afe835 (127.25.170.2:41709): tablet 2ecdd08c4b214f7e9a1e357bac491858 (table test-table [id=5675cd796af748359eb5c95d745f3ae4]) successfully deleted
I20260808 08:33:54.271531 13340 catalog_manager.cc:4841] TS bb183bd0a3fa4fdd9840ea34d57f3401 (127.25.170.3:44599): tablet 2ecdd08c4b214f7e9a1e357bac491858 (table test-table [id=5675cd796af748359eb5c95d745f3ae4]) successfully deleted
W20260808 08:33:54.272315 13342 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:33873 (error 108)
I20260808 08:33:54.273190 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 13555
I20260808 08:33:54.273406 13841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.273083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:33873 (local address 127.0.0.1:44596)
0808 08:33:54.273210 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:54.273295 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:33873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 08:33:54.274564 13342 catalog_manager.cc:4584] TS efaf7c55e19d4a969d205824e5bd35ab (127.25.170.1:33873): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2ecdd08c4b214f7e9a1e357bac491858: Network error: Client connection negotiation failed: client connection to 127.25.170.1:33873: connect: Connection refused (error 111)
I20260808 08:33:54.285952 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 13692
I20260808 08:33:54.292829 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 13323
2026-08-08T08:33:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1006 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:54 dist-test-slave-zkpd krb5kdc[13872](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:54 dist-test-slave-zkpd krb5kdc[13872](info): set up 2 sockets
Aug 08 08:33:54 dist-test-slave-zkpd krb5kdc[13872](info): commencing operation
krb5kdc: starting...
W20260808 08:33:55.349627 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:33:55 dist-test-slave-zkpd krb5kdc[13872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:33:55.472841 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:46783
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:34759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:46783
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:55.582082 13885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:55.582333 13885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:55.582371 13885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:55.586189 13885 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:55.586237 13885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:55.586256 13885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:55.586272 13885 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:55.586287 13885 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:55.591480 13885 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:34759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:46783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:46783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:55.592454 13885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:55.593364 13885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:55.601635 13894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:55.601634 13892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:55.601646 13890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:55.602015 13885 server_base.cc:1034] running on GCE node
I20260808 08:33:55.602564 13885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:55.603574 13885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:55.604741 13885 hybrid_clock.cc:648] HybridClock initialized: now 1786178035604706 us; error 48 us; skew 500 ppm
Aug 08 08:33:55 dist-test-slave-zkpd krb5kdc[13872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178035, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:55.607486 13885 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:33:55.608394 13885 webserver.cc:460] Webserver started at http://127.25.170.62:37877/ using document root <none> and password file <none>
I20260808 08:33:55.608935 13885 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:55.609023 13885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:55.609242 13885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:55.611212 13885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "540e179b84e6486fb44ad736c0640ac5"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-zkpd"
server_key: "ac4be4185d2e3535422dc4f10cb7a84a"
server_key_iv: "9098cbe1a28797826d3c9f0210a21693"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.611796 13885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "540e179b84e6486fb44ad736c0640ac5"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-zkpd"
server_key: "ac4be4185d2e3535422dc4f10cb7a84a"
server_key_iv: "9098cbe1a28797826d3c9f0210a21693"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.615445 13885 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:55.617834 13902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:55.619050 13885 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:55.619186 13885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "540e179b84e6486fb44ad736c0640ac5"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-zkpd"
server_key: "ac4be4185d2e3535422dc4f10cb7a84a"
server_key_iv: "9098cbe1a28797826d3c9f0210a21693"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.619297 13885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:55.635483 13885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:55.638214 13885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:55.638415 13885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:55.645267 13885 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:46783
I20260808 08:33:55.645299 13955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:46783 every 8 connection(s)
I20260808 08:33:55.646142 13885 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:55.648767 13956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:55.649020 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 13885
I20260808 08:33:55.649161 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:33:55.649467 26280 external_mini_cluster.cc:1428] Setting key 8661ce3277041f1f6807eedb269d8260
I20260808 08:33:55.655059 13956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5: Bootstrap starting.
I20260808 08:33:55.657395 13956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5: Neither blocks nor log segments found. Creating new log.
Aug 08 08:33:55 dist-test-slave-zkpd krb5kdc[13872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:55.658190 13956 log.cc:824] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:55.660013 13956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5: No bootstrap required, opened a new log
I20260808 08:33:55.663102 13959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:55.650832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49702 (local address 127.25.170.62:46783)
0808 08:33:55.651253 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:55.651267 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:55.651301 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:33:55.652062 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:55.652081 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:55.652393 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:55.652717 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:55.653519 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.654458 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.655397 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.655864 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.656070 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:55.658533 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:55.658538 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:55.658551 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:55.658578 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:55.660402 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:55.660873 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:55.660878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:55.660882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:55.661005 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:55.661302 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:55.661305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:55.661307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:55.661673 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:55.661875 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:55.662170 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 08:33:55.662438 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":115,"threads_started":1}
I20260808 08:33:55.663594 13956 raft_consensus.cc:348] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "540e179b84e6486fb44ad736c0640ac5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46783 } }
I20260808 08:33:55.663844 13956 raft_consensus.cc:374] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:55.663941 13956 raft_consensus.cc:729] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 540e179b84e6486fb44ad736c0640ac5, State: Initialized, Role: FOLLOWER
I20260808 08:33:55.664412 13956 consensus_queue.cc:260] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "540e179b84e6486fb44ad736c0640ac5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46783 } }
I20260808 08:33:55.664567 13956 raft_consensus.cc:388] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:55.664634 13956 raft_consensus.cc:482] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:55.664726 13956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:55.665725 13956 raft_consensus.cc:504] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "540e179b84e6486fb44ad736c0640ac5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46783 } }
I20260808 08:33:55.666008 13956 leader_election.cc:302] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 540e179b84e6486fb44ad736c0640ac5; no voters:
I20260808 08:33:55.666268 13956 leader_election.cc:288] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:55.666399 13962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:55.666615 13962 raft_consensus.cc:686] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [term 1 LEADER]: Becoming Leader. State: Replica: 540e179b84e6486fb44ad736c0640ac5, State: Running, Role: LEADER
I20260808 08:33:55.666967 13962 consensus_queue.cc:237] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "540e179b84e6486fb44ad736c0640ac5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46783 } }
I20260808 08:33:55.667472 13956 sys_catalog.cc:564] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:55.668664 13964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 540e179b84e6486fb44ad736c0640ac5. Latest consensus state: current_term: 1 leader_uuid: "540e179b84e6486fb44ad736c0640ac5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "540e179b84e6486fb44ad736c0640ac5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46783 } } }
I20260808 08:33:55.668787 13964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:55.669250 13963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "540e179b84e6486fb44ad736c0640ac5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "540e179b84e6486fb44ad736c0640ac5" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46783 } } }
I20260808 08:33:55.669344 13963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:55.669943 13974 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:55.672639 13974 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:55.678092 13974 catalog_manager.cc:1347] Generated new cluster ID: 0dbbb50d47af4f2c94b390b5f7741710
I20260808 08:33:55.678151 13974 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:55.683292 13974 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:55.684481 13974 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:55.703291 13974 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5: Generated new TSK 0
I20260808 08:33:55.704052 13974 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.170.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
Entry for principal kudu/127.25.170.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab.
I20260808 08:33:55.738444 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46783
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:34759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:55.850397 13987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:55.850622 13987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:55.850663 13987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:55.854470 13987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:55.854516 13987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:55.854570 13987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:33:55.859608 13987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:34759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.1.keytab
--principal=kudu/127.25.170.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:55.860491 13987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:55.861462 13987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:55.870904 13993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:55.870930 13995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:55.870950 13987 server_base.cc:1034] running on GCE node
W20260808 08:33:55.871124 13992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:55.871582 13987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:55.872233 13987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:55.873426 13987 hybrid_clock.cc:648] HybridClock initialized: now 1786178035873403 us; error 34 us; skew 500 ppm
Aug 08 08:33:55 dist-test-slave-zkpd krb5kdc[13872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178035, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:55.876144 13987 init.cc:377] Logged in from keytab as kudu/127.25.170.1@KRBTEST.COM (short username kudu)
I20260808 08:33:55.876951 13987 webserver.cc:460] Webserver started at http://127.25.170.1:41221/ using document root <none> and password file <none>
I20260808 08:33:55.877493 13987 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:55.877583 13987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:55.877810 13987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:55.879747 13987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "e12b9e80c66745679c8539c4383b4d47"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-zkpd"
server_key: "1816e5d5bf9a1c1018e6883c5755d2cc"
server_key_iv: "dee014538cf2a0942c8e1e5b1250350b"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.880376 13987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "e12b9e80c66745679c8539c4383b4d47"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-zkpd"
server_key: "1816e5d5bf9a1c1018e6883c5755d2cc"
server_key_iv: "dee014538cf2a0942c8e1e5b1250350b"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.884013 13987 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:55.886278 14004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:55.887399 13987 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:55.887530 13987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "e12b9e80c66745679c8539c4383b4d47"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-zkpd"
server_key: "1816e5d5bf9a1c1018e6883c5755d2cc"
server_key_iv: "dee014538cf2a0942c8e1e5b1250350b"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.887636 13987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:55.909557 13987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:55.912364 13987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:55.912561 13987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:55.913141 13987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:55.913975 13987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:55.914047 13987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:55.914119 13987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:55.914175 13987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:55.923560 13987 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:42539
I20260808 08:33:55.923600 14123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:42539 every 8 connection(s)
I20260808 08:33:55.924497 13987 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:55.924795 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 13987
I20260808 08:33:55.924960 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:55.925318 26280 external_mini_cluster.cc:1428] Setting key 323ccfff95b0363a32cca2167d7ff8e6
Aug 08 08:33:55 dist-test-slave-zkpd krb5kdc[13872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178035, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.1@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.2@KRBTEST.COM" created.
I20260808 08:33:55.940551 13959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:55.926409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:43813 (local address 127.25.170.62:46783)
0808 08:33:55.926551 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:55.926555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:55.927593 (+ 1038us) server_negotiation.cc:407] Connection header received
0808 08:33:55.929518 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:55.929524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:55.929587 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:55.929686 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:55.930973 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.931506 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.933444 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.933683 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.933780 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:55.936674 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:55.936678 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:55.936681 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:55.936705 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:55.938247 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:55.938843 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:55.938848 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:55.938852 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:55.938942 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:55.939287 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:55.939292 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:55.939293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:55.939561 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:55.939663 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:55.940319 (+ 656us) server_negotiation.cc:299] Negotiation successful
0808 08:33:55.940428 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:33:55.941730 14126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:55.926886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:46783 (local address 127.25.170.1:43813)
0808 08:33:55.927419 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:55.927482 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:55.929279 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:55.929840 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:55.929846 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:55.930187 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:55.930811 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:55.930835 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.931643 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.931650 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:55.933310 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:55.933328 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.933864 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.933870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:55.934117 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:55.934764 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:55.934790 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:55.936500 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:55.938405 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:55.938411 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:55.938426 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:55.938686 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:55.939030 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:55.939032 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:55.939034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:55.939166 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:55.939679 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:55.939684 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:55.940037 (+ 353us) client_negotiation.cc:769] Sending connection context
0808 08:33:55.940255 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 08:33:55.940636 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":121,"threads_started":1}
I20260808 08:33:55.943018 14124 heartbeater.cc:347] Connected to a master server at 127.25.170.62:46783
I20260808 08:33:55.943272 14124 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:55.943769 14124 heartbeater.cc:511] Master 127.25.170.62:46783 requested a full tablet report, sending...
I20260808 08:33:55.945531 13919 ts_manager.cc:194] Registered new tserver with Master: e12b9e80c66745679c8539c4383b4d47 (127.25.170.1:42539)
I20260808 08:33:55.947180 13919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.1@KRBTEST.COM'} at 127.25.170.1:43813
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
Entry for principal kudu/127.25.170.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab.
I20260808 08:33:55.954797 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46783
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:34759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:56.066231 14130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:56.066454 14130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:56.066512 14130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:56.071020 14130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:56.071105 14130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:56.071214 14130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:33:56.076578 14130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:34759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.2.keytab
--principal=kudu/127.25.170.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:56.077613 14130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:56.078626 14130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:56.088047 14135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:56.088094 14138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:56.088186 14130 server_base.cc:1034] running on GCE node
W20260808 08:33:56.088090 14136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:56.088673 14130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:56.089289 14130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:56.090489 14130 hybrid_clock.cc:648] HybridClock initialized: now 1786178036090469 us; error 26 us; skew 500 ppm
Aug 08 08:33:56 dist-test-slave-zkpd krb5kdc[13872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:56.093315 14130 init.cc:377] Logged in from keytab as kudu/127.25.170.2@KRBTEST.COM (short username kudu)
I20260808 08:33:56.094158 14130 webserver.cc:460] Webserver started at http://127.25.170.2:34371/ using document root <none> and password file <none>
I20260808 08:33:56.094696 14130 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:56.094758 14130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:56.095016 14130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:56.097110 14130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "a8885c27155b45359483ad4a533f1f1e"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-zkpd"
server_key: "182d520011d3bfd4dcdc4f1ae7a61ea0"
server_key_iv: "da0de7721e007407aee7d95a4cc9142f"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.097671 14130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "a8885c27155b45359483ad4a533f1f1e"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-zkpd"
server_key: "182d520011d3bfd4dcdc4f1ae7a61ea0"
server_key_iv: "da0de7721e007407aee7d95a4cc9142f"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.101349 14130 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:56.103690 14145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:56.104916 14130 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:56.105049 14130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "a8885c27155b45359483ad4a533f1f1e"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-zkpd"
server_key: "182d520011d3bfd4dcdc4f1ae7a61ea0"
server_key_iv: "da0de7721e007407aee7d95a4cc9142f"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.105156 14130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:56.129284 14130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:56.132115 14130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:56.132303 14130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:56.132871 14130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:56.133689 14130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:56.133788 14130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:56.133886 14130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:56.133936 14130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:56.142838 14130 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:44653
I20260808 08:33:56.142867 14265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:44653 every 8 connection(s)
I20260808 08:33:56.143688 14130 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:56.151207 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 14130
I20260808 08:33:56.151357 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:56.151738 26280 external_mini_cluster.cc:1428] Setting key 3207782a3bf995fef6f66530cd8c348a
Aug 08 08:33:56 dist-test-slave-zkpd krb5kdc[13872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.2@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:56.157213 13959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.145443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:53231 (local address 127.25.170.62:46783)
0808 08:33:56.145605 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.145610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.146422 (+ 812us) server_negotiation.cc:407] Connection header received
0808 08:33:56.147629 (+ 1207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.147632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.147679 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.147757 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:56.148924 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.149439 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.150510 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.150722 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.150804 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.153421 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:56.153425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:56.153427 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:56.153450 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:56.154949 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.155585 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.155590 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.155592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.155675 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.156100 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.156104 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.156106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.156288 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:56.156425 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.156924 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.157044 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:33:56.157971 14268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.145837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:46783 (local address 127.25.170.2:53231)
0808 08:33:56.146267 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:56.146309 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:56.147439 (+ 1130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:56.147978 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:56.147984 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:56.148336 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:56.148798 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.148811 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.149546 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.149548 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.150407 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.150415 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.150850 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.150852 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.150993 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.151642 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:56.151665 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:56.153248 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:56.155074 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:56.155083 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:56.155100 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:56.155474 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:56.155772 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:56.155776 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:56.155778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:56.156001 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:56.156414 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:56.156421 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:56.156668 (+ 247us) client_negotiation.cc:769] Sending connection context
0808 08:33:56.156862 (+ 194us) client_negotiation.cc:240] Negotiation successful
0808 08:33:56.157171 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":102,"threads_started":1}
I20260808 08:33:56.159308 14266 heartbeater.cc:347] Connected to a master server at 127.25.170.62:46783
I20260808 08:33:56.159547 14266 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:56.160095 14266 heartbeater.cc:511] Master 127.25.170.62:46783 requested a full tablet report, sending...
I20260808 08:33:56.161154 13919 ts_manager.cc:194] Registered new tserver with Master: a8885c27155b45359483ad4a533f1f1e (127.25.170.2:44653)
I20260808 08:33:56.161732 13919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.2@KRBTEST.COM'} at 127.25.170.2:53231
WARNING: no policy specified for kudu/127.25.170.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
Entry for principal kudu/127.25.170.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab.
I20260808 08:33:56.180627 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46783
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:34759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:56.293179 14271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:56.293411 14271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:56.293453 14271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:56.297456 14271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:56.297510 14271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:56.297565 14271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:33:56.302589 14271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:34759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.3.keytab
--principal=kudu/127.25.170.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:46783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:56.303572 14271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:56.304569 14271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:56.314023 14279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:56.314018 14277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:56.314018 14276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:56.314406 14271 server_base.cc:1034] running on GCE node
I20260808 08:33:56.314803 14271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:56.315366 14271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:56.316524 14271 hybrid_clock.cc:648] HybridClock initialized: now 1786178036316504 us; error 30 us; skew 500 ppm
Aug 08 08:33:56 dist-test-slave-zkpd krb5kdc[13872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:56.319262 14271 init.cc:377] Logged in from keytab as kudu/127.25.170.3@KRBTEST.COM (short username kudu)
I20260808 08:33:56.320191 14271 webserver.cc:460] Webserver started at http://127.25.170.3:33437/ using document root <none> and password file <none>
I20260808 08:33:56.320748 14271 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:56.320809 14271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:56.321022 14271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:56.323073 14271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "7d7487f8223941fd8fcfadb6066a4067"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-zkpd"
server_key: "dea773c521ef454df4b90f69eef863dd"
server_key_iv: "c6b5d34b046f1c697d31d2c9a7b44aef"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.323660 14271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "7d7487f8223941fd8fcfadb6066a4067"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-zkpd"
server_key: "dea773c521ef454df4b90f69eef863dd"
server_key_iv: "c6b5d34b046f1c697d31d2c9a7b44aef"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.327615 14271 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:33:56.330168 14289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:56.331410 14271 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:33:56.331548 14271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "7d7487f8223941fd8fcfadb6066a4067"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-zkpd"
server_key: "dea773c521ef454df4b90f69eef863dd"
server_key_iv: "c6b5d34b046f1c697d31d2c9a7b44aef"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.331662 14271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:56.352771 14271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:56.355691 14271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:56.355926 14271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:56.356562 14271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:56.357412 14271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:56.357484 14271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:56.357559 14271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:56.357602 14271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:56.366667 14271 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:42153
I20260808 08:33:56.366694 14407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:42153 every 8 connection(s)
I20260808 08:33:56.367551 14271 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
Aug 08 08:33:56 dist-test-slave-zkpd krb5kdc[13872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.3@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:33:56.377400 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 14271
I20260808 08:33:56.377553 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:56.377856 26280 external_mini_cluster.cc:1428] Setting key f48d59ef0bc56f67de932543c4d249f7
I20260808 08:33:56.381309 13959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.369534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:58903 (local address 127.25.170.62:46783)
0808 08:33:56.369707 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.369712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.370556 (+ 844us) server_negotiation.cc:407] Connection header received
0808 08:33:56.371821 (+ 1265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.371825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.371883 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.371997 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:56.373181 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.373825 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.374988 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.375219 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.375344 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.377760 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:56.377764 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:56.377766 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:56.377789 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:56.379445 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.379942 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.379945 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.379947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.380042 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.380418 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.380420 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.380421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.380587 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:56.380667 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.381101 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.381197 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:33:56.382093 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.369961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:46783 (local address 127.25.170.3:58903)
0808 08:33:56.370397 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:56.370440 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:56.371585 (+ 1145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:56.372171 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:56.372178 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:56.372534 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:56.373022 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.373036 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.373963 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.373968 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.374847 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.374856 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.375380 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.375384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.375564 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.376089 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:56.376105 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:56.377564 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:56.379557 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:56.379562 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:56.379573 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:56.379822 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:56.380161 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:56.380163 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:56.380165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:56.380329 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:56.380678 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:56.380682 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:56.380902 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 08:33:56.381049 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 08:33:56.381285 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":103,"threads_started":1}
I20260808 08:33:56.383175 14408 heartbeater.cc:347] Connected to a master server at 127.25.170.62:46783
I20260808 08:33:56.383416 14408 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:56.383884 14408 heartbeater.cc:511] Master 127.25.170.62:46783 requested a full tablet report, sending...
I20260808 08:33:56.384989 13919 ts_manager.cc:194] Registered new tserver with Master: 7d7487f8223941fd8fcfadb6066a4067 (127.25.170.3:42153)
I20260808 08:33:56.385536 13919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.170.3@KRBTEST.COM'} at 127.25.170.3:58903
I20260808 08:33:56.391757 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:33:56.400524 13959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.393715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49710 (local address 127.25.170.62:46783)
0808 08:33:56.393830 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.393833 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.394127 (+ 294us) server_negotiation.cc:407] Connection header received
0808 08:33:56.394232 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.394234 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.394270 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.394343 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:56.395027 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.395517 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.396398 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.396599 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.396671 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.397891 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:56.397894 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:56.397896 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:56.397918 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:56.399148 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.399526 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.399528 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.399529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.399600 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.399832 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.399834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.399835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.400031 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:56.400128 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.400336 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.400419 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:33:56.403053 13919 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:56.406077 13919 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:56.420766 14420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.415104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:44653 (local address 127.0.0.1:37492)
0808 08:33:56.415971 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:56.415985 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:56.416072 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:56.416558 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:56.416560 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:56.416570 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:56.416680 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.416688 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.418172 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.418175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.419106 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.419116 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.420206 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.420210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.420327 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.420371 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 08:33:56.420477 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:33:56.420594 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":809,"mutex_wait_us":63,"thread_start_us":100,"threads_started":1}
I20260808 08:33:56.420922 14424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.415178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45290 (local address 127.25.170.3:42153)
0808 08:33:56.416052 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.416065 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.416083 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:33:56.416157 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.416162 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.416340 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.416496 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:56.416938 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.417742 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.419486 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.420294 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.420409 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.420540 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.420662 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.420768 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":758,"thread_start_us":164,"threads_started":1}
I20260808 08:33:56.421262 14423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.414487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:42153 (local address 127.0.0.1:45290)
0808 08:33:56.415629 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:56.415641 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:56.415748 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:56.416480 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:56.416482 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:56.416495 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:56.416828 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.416833 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.417882 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.417889 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.419355 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.419367 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.420419 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.420423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.420521 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.420547 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:33:56.420631 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 08:33:56.420703 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1076,"mutex_wait_us":263,"thread_start_us":113,"threads_started":1}
I20260808 08:33:56.421509 14422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.414543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45428 (local address 127.25.170.1:42539)
0808 08:33:56.415150 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.415167 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.415737 (+ 570us) server_negotiation.cc:407] Connection header received
0808 08:33:56.415824 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.415830 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.416077 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.416224 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:56.416760 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.418006 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.419555 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.420216 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.420328 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.420473 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.420846 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.421240 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":93,"threads_started":1}
I20260808 08:33:56.421804 14425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.415523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37492 (local address 127.25.170.2:44653)
0808 08:33:56.415917 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.415930 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.416073 (+ 143us) server_negotiation.cc:407] Connection header received
0808 08:33:56.416171 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.416176 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.416346 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.416496 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:56.416789 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.418009 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.419234 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.420063 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.420182 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.420339 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.421533 (+ 1194us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.421648 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":139,"threads_started":1}
I20260808 08:33:56.421296 14421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.414410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:42539 (local address 127.0.0.1:45428)
0808 08:33:56.415408 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:56.415457 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:56.415585 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:56.416395 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:56.416401 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:56.416419 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:56.416616 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.416623 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.418172 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.418175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.419463 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.419473 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.420535 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.420538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.420618 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.420639 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 08:33:56.420707 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 08:33:56.420765 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":820,"mutex_wait_us":155,"thread_start_us":78,"threads_started":1}
I20260808 08:33:56.424443 14197 tablet_service.cc:1467] Processing CreateTablet for tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d (DEFAULT_TABLE table=test-table [id=e6b6f19be0f848df8bd2a5b32c7fa452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:56.424448 14339 tablet_service.cc:1467] Processing CreateTablet for tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d (DEFAULT_TABLE table=test-table [id=e6b6f19be0f848df8bd2a5b32c7fa452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:56.425031 14055 tablet_service.cc:1467] Processing CreateTablet for tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d (DEFAULT_TABLE table=test-table [id=e6b6f19be0f848df8bd2a5b32c7fa452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:56.425679 14339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:56.425855 14197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:56.425989 14055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:56.432180 14427 tablet_bootstrap.cc:492] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: Bootstrap starting.
I20260808 08:33:56.433578 14429 tablet_bootstrap.cc:492] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47: Bootstrap starting.
I20260808 08:33:56.433861 14428 tablet_bootstrap.cc:492] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: Bootstrap starting.
I20260808 08:33:56.434672 14427 tablet_bootstrap.cc:654] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:56.435953 14428 tablet_bootstrap.cc:654] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:56.435990 14429 tablet_bootstrap.cc:654] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:56.436072 14427 log.cc:824] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:56.437237 14428 log.cc:824] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:56.437285 14429 log.cc:824] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:56.438349 14427 tablet_bootstrap.cc:492] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: No bootstrap required, opened a new log
I20260808 08:33:56.438541 14427 ts_tablet_manager.cc:1397] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260808 08:33:56.439064 14429 tablet_bootstrap.cc:492] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47: No bootstrap required, opened a new log
I20260808 08:33:56.439199 14428 tablet_bootstrap.cc:492] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: No bootstrap required, opened a new log
I20260808 08:33:56.439291 14429 ts_tablet_manager.cc:1397] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260808 08:33:56.439378 14428 ts_tablet_manager.cc:1397] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:33:56.442104 14429 raft_consensus.cc:348] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 } } peers { permanent_uuid: "7d7487f8223941fd8fcfadb6066a4067" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42153 } } peers { permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 } }
I20260808 08:33:56.442356 14429 raft_consensus.cc:374] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:56.442435 14429 raft_consensus.cc:729] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12b9e80c66745679c8539c4383b4d47, State: Initialized, Role: FOLLOWER
I20260808 08:33:56.442503 14427 raft_consensus.cc:348] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 } } peers { permanent_uuid: "7d7487f8223941fd8fcfadb6066a4067" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42153 } } peers { permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 } }
I20260808 08:33:56.442800 14427 raft_consensus.cc:374] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:56.442868 14427 raft_consensus.cc:729] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8885c27155b45359483ad4a533f1f1e, State: Initialized, Role: FOLLOWER
I20260808 08:33:56.442965 14429 consensus_queue.cc:260] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 } } peers { permanent_uuid: "7d7487f8223941fd8fcfadb6066a4067" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42153 } } peers { permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 } }
I20260808 08:33:56.443126 14428 raft_consensus.cc:348] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 } } peers { permanent_uuid: "7d7487f8223941fd8fcfadb6066a4067" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42153 } } peers { permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 } }
I20260808 08:33:56.443388 14428 raft_consensus.cc:374] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:56.443356 14427 consensus_queue.cc:260] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 } } peers { permanent_uuid: "7d7487f8223941fd8fcfadb6066a4067" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42153 } } peers { permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 } }
I20260808 08:33:56.443452 14428 raft_consensus.cc:729] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d7487f8223941fd8fcfadb6066a4067, State: Initialized, Role: FOLLOWER
I20260808 08:33:56.443922 14428 consensus_queue.cc:260] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 } } peers { permanent_uuid: "7d7487f8223941fd8fcfadb6066a4067" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42153 } } peers { permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 } }
I20260808 08:33:56.444048 14429 ts_tablet_manager.cc:1428] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260808 08:33:56.444229 14124 heartbeater.cc:503] Master 127.25.170.62:46783 was elected leader, sending a full tablet report...
I20260808 08:33:56.444355 14427 ts_tablet_manager.cc:1428] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260808 08:33:56.444705 14266 heartbeater.cc:503] Master 127.25.170.62:46783 was elected leader, sending a full tablet report...
I20260808 08:33:56.444880 14428 ts_tablet_manager.cc:1428] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260808 08:33:56.445070 14408 heartbeater.cc:503] Master 127.25.170.62:46783 was elected leader, sending a full tablet report...
W20260808 08:33:56.618649 14409 tablet.cc:2369] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:33:56.644894 14267 tablet.cc:2369] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:56.648566 14439 raft_consensus.cc:482] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:56.648778 14439 raft_consensus.cc:504] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 } } peers { permanent_uuid: "7d7487f8223941fd8fcfadb6066a4067" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42153 } } peers { permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 } }
I20260808 08:33:56.649894 14439 leader_election.cc:288] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12b9e80c66745679c8539c4383b4d47 (127.25.170.1:42539), a8885c27155b45359483ad4a533f1f1e (127.25.170.2:44653)
I20260808 08:33:56.654452 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.650159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:42539 (local address 127.25.170.3:57385)
0808 08:33:56.650325 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:56.650342 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:56.650440 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:56.650872 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:56.650875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:56.650912 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:56.651040 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.651048 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.652117 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.652120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.653337 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.653346 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.654007 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.654010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.654123 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.654151 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 08:33:56.654239 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 08:33:56.654318 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":1,"spinlock_wait_cycles":3712}
I20260808 08:33:56.654450 14422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.650281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:57385 (local address 127.25.170.1:42539)
0808 08:33:56.650411 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.650415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.650430 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:33:56.650581 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.650585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.650644 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.650716 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:56.651175 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.652002 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.653461 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.653885 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.654015 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.654073 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.654260 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.654333 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:33:56.655074 14077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e8be1c4c6b243bc8e01f6e30eef6c5d" candidate_uuid: "7d7487f8223941fd8fcfadb6066a4067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12b9e80c66745679c8539c4383b4d47" is_pre_election: true
I20260808 08:33:56.655390 14077 raft_consensus.cc:2454] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d7487f8223941fd8fcfadb6066a4067 in term 0.
I20260808 08:33:56.655830 14440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.650436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:44653 (local address 127.25.170.3:35217)
0808 08:33:56.650770 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:56.650783 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:56.650908 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:56.652145 (+ 1237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:56.652148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:56.652168 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:56.652293 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.652299 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.653281 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.653284 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.654526 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.654537 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.655361 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.655364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.655474 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.655497 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:33:56.655612 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:33:56.655687 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"spinlock_wait_cycles":3456,"thread_start_us":104,"threads_started":1}
I20260808 08:33:56.655882 14425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.650612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:35217 (local address 127.25.170.2:44653)
0808 08:33:56.650736 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.650740 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.650881 (+ 141us) server_negotiation.cc:407] Connection header received
0808 08:33:56.651002 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.651007 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.651058 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.651137 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:56.652422 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.653164 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.654672 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.655273 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.655371 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.655416 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.655651 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.655735 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:33:56.655949 14292 leader_election.cc:302] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d7487f8223941fd8fcfadb6066a4067, e12b9e80c66745679c8539c4383b4d47; no voters:
I20260808 08:33:56.656239 14439 raft_consensus.cc:2781] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:56.656365 14439 raft_consensus.cc:482] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:56.656456 14439 raft_consensus.cc:3037] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:56.656752 14218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e8be1c4c6b243bc8e01f6e30eef6c5d" candidate_uuid: "7d7487f8223941fd8fcfadb6066a4067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8885c27155b45359483ad4a533f1f1e" is_pre_election: true
I20260808 08:33:56.657037 14218 raft_consensus.cc:2454] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d7487f8223941fd8fcfadb6066a4067 in term 0.
I20260808 08:33:56.657845 14439 raft_consensus.cc:504] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 } } peers { permanent_uuid: "7d7487f8223941fd8fcfadb6066a4067" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42153 } } peers { permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 } }
I20260808 08:33:56.658212 14439 leader_election.cc:288] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [CANDIDATE]: Term 1 election: Requested vote from peers e12b9e80c66745679c8539c4383b4d47 (127.25.170.1:42539), a8885c27155b45359483ad4a533f1f1e (127.25.170.2:44653)
I20260808 08:33:56.658581 14218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e8be1c4c6b243bc8e01f6e30eef6c5d" candidate_uuid: "7d7487f8223941fd8fcfadb6066a4067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8885c27155b45359483ad4a533f1f1e"
I20260808 08:33:56.658715 14218 raft_consensus.cc:3037] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:56.658766 14077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e8be1c4c6b243bc8e01f6e30eef6c5d" candidate_uuid: "7d7487f8223941fd8fcfadb6066a4067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12b9e80c66745679c8539c4383b4d47"
I20260808 08:33:56.658912 14077 raft_consensus.cc:3037] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:56.659782 14218 raft_consensus.cc:2454] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d7487f8223941fd8fcfadb6066a4067 in term 1.
I20260808 08:33:56.660027 14077 raft_consensus.cc:2454] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d7487f8223941fd8fcfadb6066a4067 in term 1.
I20260808 08:33:56.660162 14292 leader_election.cc:302] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d7487f8223941fd8fcfadb6066a4067, a8885c27155b45359483ad4a533f1f1e; no voters:
I20260808 08:33:56.660378 14439 raft_consensus.cc:2781] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:56.660640 14439 raft_consensus.cc:686] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 1 LEADER]: Becoming Leader. State: Replica: 7d7487f8223941fd8fcfadb6066a4067, State: Running, Role: LEADER
I20260808 08:33:56.660975 14439 consensus_queue.cc:237] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 } } peers { permanent_uuid: "7d7487f8223941fd8fcfadb6066a4067" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42153 } } peers { permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 } }
I20260808 08:33:56.664113 13918 catalog_manager.cc:5495] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d7487f8223941fd8fcfadb6066a4067 (127.25.170.3). New cstate: current_term: 1 leader_uuid: "7d7487f8223941fd8fcfadb6066a4067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d7487f8223941fd8fcfadb6066a4067" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 42153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 } health_report { overall_health: UNKNOWN } } }
W20260808 08:33:56.678231 14125 tablet.cc:2369] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:56.710908 14424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.707090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45304 (local address 127.25.170.3:42153)
0808 08:33:56.707237 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.707242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.707257 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:33:56.707389 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.707391 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.707448 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.707560 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:56.707831 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.708418 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.709376 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.709611 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.709718 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.710063 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:56.710481 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:56.710629 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.710708 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.710763 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:33:56.716691 14218 raft_consensus.cc:1261] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e [term 1 FOLLOWER]: Refusing update from remote peer 7d7487f8223941fd8fcfadb6066a4067: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:56.716701 14077 raft_consensus.cc:1261] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P e12b9e80c66745679c8539c4383b4d47 [term 1 FOLLOWER]: Refusing update from remote peer 7d7487f8223941fd8fcfadb6066a4067: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:56.717433 14439 consensus_queue.cc:1035] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12b9e80c66745679c8539c4383b4d47" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 42539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:56.717669 14441 consensus_queue.cc:1035] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8885c27155b45359483ad4a533f1f1e" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 44653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:56.725148 14446 mvcc.cc:205] Tried to move back new op lower bound from 7316185238384340992 to 7316185238165917696. Current Snapshot: MvccSnapshot[applied={T|T < 7316185238384340992}]
I20260808 08:33:56.725731 14445 mvcc.cc:205] Tried to move back new op lower bound from 7316185238384340992 to 7316185238165917696. Current Snapshot: MvccSnapshot[applied={T|T < 7316185238384340992}]
I20260808 08:33:56.733120 13918 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:56.733290 13918 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:56.735881 13918 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 540e179b84e6486fb44ad736c0640ac5: Sending DeleteTablet for 3 replicas of tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d
I20260808 08:33:56.736938 14339 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:56 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:45290
I20260808 08:33:56.737183 14197 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:56 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:37492
I20260808 08:33:56.737576 14055 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:56 UTC) from {username='kudu', principal='kudu/127.25.170.62@KRBTEST.COM'} at 127.0.0.1:45428
I20260808 08:33:56.737701 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 13987
I20260808 08:33:56.738157 14455 tablet_replica.cc:330] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: stopping tablet replica
I20260808 08:33:56.738641 14455 raft_consensus.cc:2229] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:56.739427 14455 raft_consensus.cc:2258] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:56.741178 14455 ts_tablet_manager.cc:1905] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:56.744707 14455 ts_tablet_manager.cc:1918] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:56.744818 14455 log.cc:1196] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/2e8be1c4c6b243bc8e01f6e30eef6c5d
I20260808 08:33:56.745199 14455 ts_tablet_manager.cc:1939] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P a8885c27155b45359483ad4a533f1f1e: Deleting consensus metadata
I20260808 08:33:56.746446 13905 catalog_manager.cc:4841] TS a8885c27155b45359483ad4a533f1f1e (127.25.170.2:44653): tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d (table test-table [id=e6b6f19be0f848df8bd2a5b32c7fa452]) successfully deleted
W20260808 08:33:56.748917 13905 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:42539 (error 108)
I20260808 08:33:56.749116 14454 tablet_replica.cc:330] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: stopping tablet replica
I20260808 08:33:56.749439 14454 raft_consensus.cc:2229] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:56.749778 14454 raft_consensus.cc:2258] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:56.749977 14421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.749662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:42539 (local address 127.0.0.1:45432)
0808 08:33:56.749789 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:56.749875 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:42539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 08:33:56.750058 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 14130
I20260808 08:33:56.751619 14454 ts_tablet_manager.cc:1905] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 08:33:56.753172 13905 catalog_manager.cc:4584] TS e12b9e80c66745679c8539c4383b4d47 (127.25.170.1:42539): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d: Network error: Client connection negotiation failed: client connection to 127.25.170.1:42539: connect: Connection refused (error 111)
I20260808 08:33:56.754237 14454 ts_tablet_manager.cc:1918] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:56.754339 14454 log.cc:1196] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/2e8be1c4c6b243bc8e01f6e30eef6c5d
I20260808 08:33:56.754657 14454 ts_tablet_manager.cc:1939] T 2e8be1c4c6b243bc8e01f6e30eef6c5d P 7d7487f8223941fd8fcfadb6066a4067: Deleting consensus metadata
I20260808 08:33:56.755756 13904 catalog_manager.cc:4841] TS 7d7487f8223941fd8fcfadb6066a4067 (127.25.170.3:42153): tablet 2e8be1c4c6b243bc8e01f6e30eef6c5d (table test-table [id=e6b6f19be0f848df8bd2a5b32c7fa452]) successfully deleted
I20260808 08:33:56.758792 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 14271
I20260808 08:33:56.765522 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 13885
2026-08-08T08:33:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2472 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T08:33:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:56Z Disabled control of system clock
I20260808 08:33:56.797055 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39069
--webserver_interface=127.25.170.62
--webserver_port=0
--builtin_ntp_servers=127.25.170.20:36709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:39069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:33:56.905230 14460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:56.905447 14460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:56.905479 14460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:56.909319 14460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:56.909361 14460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:56.909377 14460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:56.909394 14460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:56.909408 14460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:56.913945 14460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:39069
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:56.914816 14460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:56.916075 14460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:56.924356 14465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:56.924439 14460 server_base.cc:1034] running on GCE node
W20260808 08:33:56.924371 14468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:56.924403 14466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:56.925151 14460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:56.926157 14460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:56.927348 14460 hybrid_clock.cc:648] HybridClock initialized: now 1786178036927323 us; error 37 us; skew 500 ppm
I20260808 08:33:56.929162 14460 webserver.cc:460] Webserver started at http://127.25.170.62:32911/ using document root <none> and password file <none>
I20260808 08:33:56.929706 14460 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:56.929795 14460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:56.930029 14460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:56.932060 14460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "a4fe6b7d46b74af1941398096a6ea216"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-zkpd"
server_key: "16dfe310f515df5c1b3c9f39ffc5191d"
server_key_iv: "7296e6c09251c244ffc5b91f4773f3a2"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.932608 14460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "a4fe6b7d46b74af1941398096a6ea216"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-zkpd"
server_key: "16dfe310f515df5c1b3c9f39ffc5191d"
server_key_iv: "7296e6c09251c244ffc5b91f4773f3a2"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.936152 14460 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:33:56.938437 14474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:56.939594 14460 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:56.939735 14460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "a4fe6b7d46b74af1941398096a6ea216"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-zkpd"
server_key: "16dfe310f515df5c1b3c9f39ffc5191d"
server_key_iv: "7296e6c09251c244ffc5b91f4773f3a2"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.939857 14460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:56.976926 14460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:56.977669 14460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:56.977892 14460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:56.985399 14460 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:39069
I20260808 08:33:56.985419 14526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:39069 every 8 connection(s)
I20260808 08:33:56.986382 14460 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:56.989521 14527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:56.992936 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 14460
I20260808 08:33:56.993088 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:33:56.993359 26280 external_mini_cluster.cc:1428] Setting key 3cf5c93adf3ff5763116b513d5ef3337
I20260808 08:33:56.995362 14527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216: Bootstrap starting.
I20260808 08:33:56.997601 14527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:56.998347 14527 log.cc:824] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:57.000523 14527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216: No bootstrap required, opened a new log
I20260808 08:33:57.002882 14530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.994723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50066 (local address 127.25.170.62:39069)
0808 08:33:56.995397 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.995418 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.995468 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:33:56.996204 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.996224 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.996618 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.996963 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:56.997404 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.998417 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.999615 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.000144 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.000267 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.001171 (+ 904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:57.001177 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:57.001189 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:57.001560 (+ 371us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:57.001614 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:57.001634 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:57.001712 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.001891 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.002175 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":131,"threads_started":1}
I20260808 08:33:57.004347 14527 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4fe6b7d46b74af1941398096a6ea216" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39069 } }
I20260808 08:33:57.004577 14527 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:57.004635 14527 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fe6b7d46b74af1941398096a6ea216, State: Initialized, Role: FOLLOWER
I20260808 08:33:57.005095 14527 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4fe6b7d46b74af1941398096a6ea216" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39069 } }
I20260808 08:33:57.005240 14527 raft_consensus.cc:388] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:57.005306 14527 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:57.005475 14527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:57.006323 14527 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4fe6b7d46b74af1941398096a6ea216" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39069 } }
I20260808 08:33:57.006659 14527 leader_election.cc:302] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a4fe6b7d46b74af1941398096a6ea216; no voters:
I20260808 08:33:57.006948 14527 leader_election.cc:288] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:57.007067 14532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:57.007300 14532 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [term 1 LEADER]: Becoming Leader. State: Replica: a4fe6b7d46b74af1941398096a6ea216, State: Running, Role: LEADER
I20260808 08:33:57.007622 14532 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4fe6b7d46b74af1941398096a6ea216" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39069 } }
I20260808 08:33:57.008148 14527 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:57.009430 14534 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4fe6b7d46b74af1941398096a6ea216. Latest consensus state: current_term: 1 leader_uuid: "a4fe6b7d46b74af1941398096a6ea216" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4fe6b7d46b74af1941398096a6ea216" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39069 } } }
I20260808 08:33:57.009419 14533 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4fe6b7d46b74af1941398096a6ea216" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4fe6b7d46b74af1941398096a6ea216" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39069 } } }
I20260808 08:33:57.009558 14533 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:57.009558 14534 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216 [sys.catalog]: This master's current role is: LEADER
W20260808 08:33:57.013146 14547 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:33:57.013211 14547 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:33:57.013289 14542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:57.013995 14542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:57.019011 14542 catalog_manager.cc:1347] Generated new cluster ID: 38af80286c054ab09acee243896e36ab
I20260808 08:33:57.019069 14542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:57.039094 14542 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:57.040069 14542 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:57.050132 14542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216: Generated new TSK 0
I20260808 08:33:57.050902 14542 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:33:57.059935 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.1:0
--local_ip_for_outbound_sockets=127.25.170.1
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39069
--builtin_ntp_servers=127.25.170.20:36709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:33:57.172401 14551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:57.172678 14551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:57.172719 14551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:57.177032 14551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:57.177085 14551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:57.177140 14551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.1
I20260808 08:33:57.181785 14551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.170.1
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.1
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:57.182790 14551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:57.184161 14551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:57.193764 14560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:57.193768 14557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:57.193776 14558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:57.193856 14551 server_base.cc:1034] running on GCE node
I20260808 08:33:57.194494 14551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:57.195075 14551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:57.196233 14551 hybrid_clock.cc:648] HybridClock initialized: now 1786178037196218 us; error 24 us; skew 500 ppm
I20260808 08:33:57.198086 14551 webserver.cc:460] Webserver started at http://127.25.170.1:36023/ using document root <none> and password file <none>
I20260808 08:33:57.198655 14551 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:57.198719 14551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:57.198977 14551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:57.201066 14551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/data/instance:
uuid: "910fc676f0544b39899aefea2138e6ed"
format_stamp: "Formatted at 2026-08-08 08:33:57 on dist-test-slave-zkpd"
server_key: "08b40ceff487dfafd7ffeed3b2a3e1b5"
server_key_iv: "8821ea140d517beca6020030cfa69143"
server_key_version: "encryptionkey@0"
I20260808 08:33:57.201622 14551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance:
uuid: "910fc676f0544b39899aefea2138e6ed"
format_stamp: "Formatted at 2026-08-08 08:33:57 on dist-test-slave-zkpd"
server_key: "08b40ceff487dfafd7ffeed3b2a3e1b5"
server_key_iv: "8821ea140d517beca6020030cfa69143"
server_key_version: "encryptionkey@0"
I20260808 08:33:57.205184 14551 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:57.207444 14566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:57.208719 14551 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:57.208853 14551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/wal
uuid: "910fc676f0544b39899aefea2138e6ed"
format_stamp: "Formatted at 2026-08-08 08:33:57 on dist-test-slave-zkpd"
server_key: "08b40ceff487dfafd7ffeed3b2a3e1b5"
server_key_iv: "8821ea140d517beca6020030cfa69143"
server_key_version: "encryptionkey@0"
I20260808 08:33:57.208969 14551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:57.238107 14551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:57.238785 14551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:57.238996 14551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:57.239575 14551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:57.240521 14551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:57.240594 14551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:57.240684 14551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:57.240737 14551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:57.250026 14551 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.1:43195
I20260808 08:33:57.250049 14686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.1:43195 every 8 connection(s)
I20260808 08:33:57.250895 14551 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:57.257151 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 14551
I20260808 08:33:57.257285 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:57.257586 26280 external_mini_cluster.cc:1428] Setting key 229e26c5deadf585fdd5c4f99889cb9f
I20260808 08:33:57.259524 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.2:0
--local_ip_for_outbound_sockets=127.25.170.2
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39069
--builtin_ntp_servers=127.25.170.20:36709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:33:57.260533 14530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.252699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.1:50055 (local address 127.25.170.62:39069)
0808 08:33:57.252842 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:57.252845 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:57.253834 (+ 989us) server_negotiation.cc:407] Connection header received
0808 08:33:57.255246 (+ 1412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:57.255249 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:57.255310 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:57.255412 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:57.256353 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.256942 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.258336 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.258551 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.258635 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.259952 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:57.259959 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:57.259965 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:57.259982 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:57.260008 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:57.260021 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:57.260098 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.260251 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.260322 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:33:57.261235 14689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.253039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39069 (local address 127.25.170.1:50055)
0808 08:33:57.253665 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:57.253716 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:57.255019 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:57.255591 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:57.255598 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:57.255679 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:57.256209 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.256223 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.257071 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.257074 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.258207 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.258218 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.258703 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.258707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.258944 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.259620 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:33:57.259623 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:57.259690 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:33:57.259772 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:57.260117 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:57.260125 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:57.260129 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:33:57.260221 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:33:57.260432 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":109,"threads_started":1}
I20260808 08:33:57.262390 14687 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39069
I20260808 08:33:57.262641 14687 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:57.263157 14687 heartbeater.cc:511] Master 127.25.170.62:39069 requested a full tablet report, sending...
I20260808 08:33:57.264652 14491 ts_manager.cc:194] Registered new tserver with Master: 910fc676f0544b39899aefea2138e6ed (127.25.170.1:43195)
I20260808 08:33:57.266361 14491 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.1:50055
W20260808 08:33:57.372686 14690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:57.372918 14690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:57.372954 14690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:57.377063 14690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:57.377108 14690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:57.377159 14690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.2
I20260808 08:33:57.381608 14690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.170.2
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.2
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:57.382516 14690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:57.383803 14690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:57.392997 14696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:57.393079 14698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:57.392995 14695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:57.393337 14690 server_base.cc:1034] running on GCE node
I20260808 08:33:57.393661 14690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:57.394255 14690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:57.395418 14690 hybrid_clock.cc:648] HybridClock initialized: now 1786178037395404 us; error 24 us; skew 500 ppm
I20260808 08:33:57.397220 14690 webserver.cc:460] Webserver started at http://127.25.170.2:44709/ using document root <none> and password file <none>
I20260808 08:33:57.397819 14690 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:57.397892 14690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:57.398142 14690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:57.400152 14690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/data/instance:
uuid: "352e6987027b43f5bfb03f458cb620d2"
format_stamp: "Formatted at 2026-08-08 08:33:57 on dist-test-slave-zkpd"
server_key: "55ae474db862fc70afc82e01b41f8034"
server_key_iv: "7906c4ac1258d65ce0a9f4aadb7ecee1"
server_key_version: "encryptionkey@0"
I20260808 08:33:57.400710 14690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance:
uuid: "352e6987027b43f5bfb03f458cb620d2"
format_stamp: "Formatted at 2026-08-08 08:33:57 on dist-test-slave-zkpd"
server_key: "55ae474db862fc70afc82e01b41f8034"
server_key_iv: "7906c4ac1258d65ce0a9f4aadb7ecee1"
server_key_version: "encryptionkey@0"
I20260808 08:33:57.404211 14690 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:33:57.406451 14706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:57.407614 14690 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:57.407747 14690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/wal
uuid: "352e6987027b43f5bfb03f458cb620d2"
format_stamp: "Formatted at 2026-08-08 08:33:57 on dist-test-slave-zkpd"
server_key: "55ae474db862fc70afc82e01b41f8034"
server_key_iv: "7906c4ac1258d65ce0a9f4aadb7ecee1"
server_key_version: "encryptionkey@0"
I20260808 08:33:57.407853 14690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:57.425029 14690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:57.425678 14690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:57.425870 14690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:57.426424 14690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:57.427371 14690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:57.427435 14690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:57.427497 14690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:57.427556 14690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:57.436280 14690 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.2:41205
I20260808 08:33:57.436311 14826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.2:41205 every 8 connection(s)
I20260808 08:33:57.437130 14690 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:57.437630 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 14690
I20260808 08:33:57.437767 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:57.438073 26280 external_mini_cluster.cc:1428] Setting key 7f846d679248d65a85e2042b9e35aa1e
I20260808 08:33:57.440344 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.170.3:0
--local_ip_for_outbound_sockets=127.25.170.3
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39069
--builtin_ntp_servers=127.25.170.20:36709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:33:57.447366 14530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.438925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.2:35911 (local address 127.25.170.62:39069)
0808 08:33:57.439066 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:57.439071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:57.440333 (+ 1262us) server_negotiation.cc:407] Connection header received
0808 08:33:57.442461 (+ 2128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:57.442464 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:57.442520 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:57.442601 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:57.443538 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.444205 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.445446 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.445669 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.445786 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.446889 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:57.446893 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:57.446895 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:57.446906 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:57.446924 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:57.446931 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:57.447006 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.447166 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.447226 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:33:57.448227 14830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.439338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39069 (local address 127.25.170.2:35911)
0808 08:33:57.440168 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:57.440228 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:57.442171 (+ 1943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:57.442762 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:57.442768 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:57.442852 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:57.443398 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.443413 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.444361 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.444364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.445316 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.445333 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.445825 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.445830 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.445995 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.446632 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:33:57.446633 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:57.446671 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:33:57.446730 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:57.447023 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:57.447040 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:57.447044 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:33:57.447164 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 08:33:57.447439 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":159,"threads_started":1}
I20260808 08:33:57.449316 14827 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39069
I20260808 08:33:57.449571 14827 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:57.450207 14827 heartbeater.cc:511] Master 127.25.170.62:39069 requested a full tablet report, sending...
I20260808 08:33:57.451318 14491 ts_manager.cc:194] Registered new tserver with Master: 352e6987027b43f5bfb03f458cb620d2 (127.25.170.2:41205)
I20260808 08:33:57.451874 14491 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.2:35911
W20260808 08:33:57.556625 14831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:57.556878 14831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:57.556914 14831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:57.560870 14831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:57.560916 14831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:57.561007 14831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.170.3
I20260808 08:33:57.565642 14831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:36709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.170.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.170.3
--webserver_port=0
--tserver_master_addrs=127.25.170.62:39069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.170.3
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:57.566636 14831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:57.568112 14831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:57.577493 14837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:57.577471 14836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:57.577484 14839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:57.577833 14831 server_base.cc:1034] running on GCE node
I20260808 08:33:57.578219 14831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:57.578831 14831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:57.579963 14831 hybrid_clock.cc:648] HybridClock initialized: now 1786178037579947 us; error 25 us; skew 500 ppm
I20260808 08:33:57.584628 14831 webserver.cc:460] Webserver started at http://127.25.170.3:40089/ using document root <none> and password file <none>
I20260808 08:33:57.585197 14831 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:57.585260 14831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:57.585502 14831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:57.587601 14831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/data/instance:
uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a"
format_stamp: "Formatted at 2026-08-08 08:33:57 on dist-test-slave-zkpd"
server_key: "9604cd137f0cf8522f1f86a2a0b94fd4"
server_key_iv: "c3f54883526e61db22e3b090c25cc9ba"
server_key_version: "encryptionkey@0"
I20260808 08:33:57.588232 14831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance:
uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a"
format_stamp: "Formatted at 2026-08-08 08:33:57 on dist-test-slave-zkpd"
server_key: "9604cd137f0cf8522f1f86a2a0b94fd4"
server_key_iv: "c3f54883526e61db22e3b090c25cc9ba"
server_key_version: "encryptionkey@0"
I20260808 08:33:57.592113 14831 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:33:57.594507 14848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:57.595672 14831 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:57.595813 14831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/wal
uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a"
format_stamp: "Formatted at 2026-08-08 08:33:57 on dist-test-slave-zkpd"
server_key: "9604cd137f0cf8522f1f86a2a0b94fd4"
server_key_iv: "c3f54883526e61db22e3b090c25cc9ba"
server_key_version: "encryptionkey@0"
I20260808 08:33:57.595949 14831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:57.615471 14831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:57.616253 14831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:57.616456 14831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:57.617058 14831 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:57.618060 14831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:57.618130 14831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:57.618203 14831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:57.618249 14831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:57.627110 14831 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.3:38227
I20260808 08:33:57.627141 14966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.3:38227 every 8 connection(s)
I20260808 08:33:57.628067 14831 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:57.637246 14530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.629791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:42865 (local address 127.25.170.62:39069)
0808 08:33:57.629940 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:57.629944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:57.630909 (+ 965us) server_negotiation.cc:407] Connection header received
0808 08:33:57.632449 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:57.632453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:57.632514 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:57.632622 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:57.633529 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.634081 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.635243 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.635478 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.635596 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.636736 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:57.636739 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:57.636742 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:57.636758 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:57.636782 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:57.636790 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:57.636871 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.637037 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.637101 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:33:57.637974 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 14831
I20260808 08:33:57.638108 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:57.638089 14970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.630134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:39069 (local address 127.25.170.3:42865)
0808 08:33:57.630762 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:57.630801 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:57.632218 (+ 1417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:57.632801 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:57.632808 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:57.632893 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:57.633381 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.633393 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.634220 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.634228 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.635102 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.635112 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.635642 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.635646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.635816 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.636466 (+ 650us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:33:57.636468 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:57.636508 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:33:57.636570 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:57.636887 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:57.636899 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:57.636911 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 08:33:57.637035 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 08:33:57.637316 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":114,"threads_started":1}
I20260808 08:33:57.638514 26280 external_mini_cluster.cc:1428] Setting key bc2ee7395526d2780535ac888a9365fe
I20260808 08:33:57.639403 14967 heartbeater.cc:347] Connected to a master server at 127.25.170.62:39069
I20260808 08:33:57.639659 14967 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:57.640254 14967 heartbeater.cc:511] Master 127.25.170.62:39069 requested a full tablet report, sending...
I20260808 08:33:57.641281 14491 ts_manager.cc:194] Registered new tserver with Master: 9b3ca1cfd6fb4fa784dfad5f6e5ed21a (127.25.170.3:38227)
I20260808 08:33:57.641865 14491 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.170.3:42865
I20260808 08:33:57.652333 26280 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:33:57.658308 14530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.654242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50068 (local address 127.25.170.62:39069)
0808 08:33:57.654408 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:57.654414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:57.654613 (+ 199us) server_negotiation.cc:407] Connection header received
0808 08:33:57.654755 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:57.654758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:57.654802 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:57.654900 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:57.655191 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.655700 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.656639 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.656879 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.656989 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.657885 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:57.657888 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:57.657891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:57.657904 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:57.657927 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:57.657940 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:57.658018 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.658109 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.658165 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:33:57.661085 14491 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50068:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:57.664172 14491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:57.678069 14982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.673084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49780 (local address 127.25.170.1:43195)
0808 08:33:57.673472 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:57.673484 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:57.673508 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:33:57.673585 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:57.673591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:57.673782 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:57.674232 (+ 450us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:57.674370 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.675379 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.676775 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.677386 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.677512 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.677709 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.677808 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.677904 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":108,"threads_started":1}
I20260808 08:33:57.678063 14980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.672465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:43195 (local address 127.0.0.1:49780)
0808 08:33:57.673128 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:57.673142 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:57.673226 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:57.673961 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:57.673964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:57.673984 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:57.674075 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.674081 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.675498 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.675501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.676649 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.676657 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.677516 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.677519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.677625 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.677662 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:33:57.677780 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 08:33:57.677905 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"mutex_wait_us":5,"thread_start_us":117,"threads_started":1}
I20260808 08:33:57.678453 14979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.672256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.3:38227 (local address 127.0.0.1:36018)
0808 08:33:57.672622 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:57.672671 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:57.672788 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:57.673723 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:57.673729 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:57.673755 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:57.673898 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.673907 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.675326 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.675329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.676766 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.676776 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.678074 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.678078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.678164 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.678186 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:33:57.678256 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 08:33:57.678321 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":44,"thread_start_us":101,"threads_started":1}
I20260808 08:33:57.679035 14981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.672412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36018 (local address 127.25.170.3:38227)
0808 08:33:57.673116 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:57.673128 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:57.673157 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:33:57.673238 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:57.673246 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:57.673482 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:57.673682 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:57.674049 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.675196 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.676895 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.677688 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.677805 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.678010 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.678736 (+ 726us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.678851 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":175,"threads_started":1}
I20260808 08:33:57.679622 14983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.673587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:41205 (local address 127.0.0.1:45410)
0808 08:33:57.674389 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:57.674405 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:57.674517 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:57.675034 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:57.675037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:57.675055 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:57.675144 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.675149 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.676616 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.676619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.677761 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.677773 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.679235 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.679241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.679341 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.679364 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:33:57.679444 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 08:33:57.679507 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"thread_start_us":88,"threads_started":1}
I20260808 08:33:57.679972 14984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.674007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45410 (local address 127.25.170.2:41205)
0808 08:33:57.674389 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:57.674407 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:57.674619 (+ 212us) server_negotiation.cc:407] Connection header received
0808 08:33:57.674722 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:57.674727 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:57.674895 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:57.675034 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:57.675265 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.676499 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.677897 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.678698 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.678960 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.679173 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.679504 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.679601 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":148,"threads_started":1}
I20260808 08:33:57.681804 14620 tablet_service.cc:1467] Processing CreateTablet for tablet 0c274475a5cc44c088ae64ea88d1cf51 (DEFAULT_TABLE table=test-table [id=41b22b5c590f4a8aac1786a9553fa8dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:57.681905 14900 tablet_service.cc:1467] Processing CreateTablet for tablet 0c274475a5cc44c088ae64ea88d1cf51 (DEFAULT_TABLE table=test-table [id=41b22b5c590f4a8aac1786a9553fa8dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:57.682832 14620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c274475a5cc44c088ae64ea88d1cf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:57.682492 14759 tablet_service.cc:1467] Processing CreateTablet for tablet 0c274475a5cc44c088ae64ea88d1cf51 (DEFAULT_TABLE table=test-table [id=41b22b5c590f4a8aac1786a9553fa8dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:57.682994 14900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c274475a5cc44c088ae64ea88d1cf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:57.683386 14759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c274475a5cc44c088ae64ea88d1cf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:57.689073 14986 tablet_bootstrap.cc:492] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed: Bootstrap starting.
I20260808 08:33:57.690996 14988 tablet_bootstrap.cc:492] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: Bootstrap starting.
I20260808 08:33:57.691481 14986 tablet_bootstrap.cc:654] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:57.692060 14987 tablet_bootstrap.cc:492] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: Bootstrap starting.
I20260808 08:33:57.692449 14986 log.cc:824] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:57.693246 14988 tablet_bootstrap.cc:654] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:57.694113 14988 log.cc:824] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:57.694177 14987 tablet_bootstrap.cc:654] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:57.695013 14987 log.cc:824] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:57.695305 14986 tablet_bootstrap.cc:492] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed: No bootstrap required, opened a new log
I20260808 08:33:57.695521 14986 ts_tablet_manager.cc:1397] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 08:33:57.696041 14988 tablet_bootstrap.cc:492] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: No bootstrap required, opened a new log
I20260808 08:33:57.696238 14988 ts_tablet_manager.cc:1397] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 08:33:57.697063 14987 tablet_bootstrap.cc:492] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: No bootstrap required, opened a new log
I20260808 08:33:57.697242 14987 ts_tablet_manager.cc:1397] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 08:33:57.699649 14988 raft_consensus.cc:348] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38227 } } peers { permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 } } peers { permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 } }
I20260808 08:33:57.699641 14986 raft_consensus.cc:348] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38227 } } peers { permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 } } peers { permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 } }
I20260808 08:33:57.699939 14986 raft_consensus.cc:374] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:57.699941 14988 raft_consensus.cc:374] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:57.699999 14988 raft_consensus.cc:729] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3ca1cfd6fb4fa784dfad5f6e5ed21a, State: Initialized, Role: FOLLOWER
I20260808 08:33:57.700001 14986 raft_consensus.cc:729] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 910fc676f0544b39899aefea2138e6ed, State: Initialized, Role: FOLLOWER
I20260808 08:33:57.700474 14986 consensus_queue.cc:260] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38227 } } peers { permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 } } peers { permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 } }
I20260808 08:33:57.700476 14988 consensus_queue.cc:260] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38227 } } peers { permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 } } peers { permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 } }
I20260808 08:33:57.701388 14988 ts_tablet_manager.cc:1428] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 08:33:57.701442 14986 ts_tablet_manager.cc:1428] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20260808 08:33:57.701532 14987 raft_consensus.cc:348] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38227 } } peers { permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 } } peers { permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 } }
I20260808 08:33:57.701762 14987 raft_consensus.cc:374] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:57.701777 14967 heartbeater.cc:503] Master 127.25.170.62:39069 was elected leader, sending a full tablet report...
I20260808 08:33:57.701802 14987 raft_consensus.cc:729] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 352e6987027b43f5bfb03f458cb620d2, State: Initialized, Role: FOLLOWER
I20260808 08:33:57.701984 14687 heartbeater.cc:503] Master 127.25.170.62:39069 was elected leader, sending a full tablet report...
I20260808 08:33:57.702133 14987 consensus_queue.cc:260] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38227 } } peers { permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 } } peers { permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 } }
I20260808 08:33:57.702795 14827 heartbeater.cc:503] Master 127.25.170.62:39069 was elected leader, sending a full tablet report...
I20260808 08:33:57.702988 14987 ts_tablet_manager.cc:1428] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
W20260808 08:33:57.752123 14688 tablet.cc:2369] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:57.764997 14993 raft_consensus.cc:482] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:57.765224 14993 raft_consensus.cc:504] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38227 } } peers { permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 } } peers { permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 } }
I20260808 08:33:57.766595 14993 leader_election.cc:288] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 910fc676f0544b39899aefea2138e6ed (127.25.170.1:43195), 352e6987027b43f5bfb03f458cb620d2 (127.25.170.2:41205)
I20260808 08:33:57.770179 14982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.766874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:48899 (local address 127.25.170.1:43195)
0808 08:33:57.767021 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:57.767028 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:57.767045 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:33:57.767221 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:57.767227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:57.767284 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:57.767364 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:57.767634 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.768214 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.769245 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.769628 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.769752 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.769814 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.769991 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.770058 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:33:57.770179 14970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.766792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:43195 (local address 127.25.170.3:48899)
0808 08:33:57.766969 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:57.766985 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:57.767094 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:57.767379 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:57.767382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:57.767401 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:57.767522 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.767528 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.768341 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.768344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.769120 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.769128 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.769753 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.769756 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.769860 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.769888 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 08:33:57.769974 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 08:33:57.770048 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 08:33:57.770757 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.767095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.2:41205 (local address 127.25.170.3:50477)
0808 08:33:57.767437 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:57.767449 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:57.767571 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:57.767812 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:57.767815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:57.767837 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:57.767992 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.767998 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.768806 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.768811 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.769581 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:57.769590 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.770362 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.770367 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:57.770459 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.770482 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:33:57.770558 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 08:33:57.770626 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":113,"threads_started":1}
I20260808 08:33:57.770817 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c274475a5cc44c088ae64ea88d1cf51" candidate_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "910fc676f0544b39899aefea2138e6ed" is_pre_election: true
I20260808 08:33:57.771138 14984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.767225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.170.3:50477 (local address 127.25.170.2:41205)
0808 08:33:57.767393 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:57.767397 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:57.767534 (+ 137us) server_negotiation.cc:407] Connection header received
0808 08:33:57.767659 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:57.767662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:57.767711 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:57.767788 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:57.768111 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.768688 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.769714 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.770096 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.770234 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.770296 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.770953 (+ 657us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.771027 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:33:57.771134 14640 raft_consensus.cc:2454] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3ca1cfd6fb4fa784dfad5f6e5ed21a in term 0.
I20260808 08:33:57.771677 14780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c274475a5cc44c088ae64ea88d1cf51" candidate_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "352e6987027b43f5bfb03f458cb620d2" is_pre_election: true
I20260808 08:33:57.771953 14780 raft_consensus.cc:2454] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b3ca1cfd6fb4fa784dfad5f6e5ed21a in term 0.
I20260808 08:33:57.772289 14852 leader_election.cc:302] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 910fc676f0544b39899aefea2138e6ed, 9b3ca1cfd6fb4fa784dfad5f6e5ed21a; no voters:
I20260808 08:33:57.772529 14993 raft_consensus.cc:2781] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:57.772631 14993 raft_consensus.cc:482] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:57.772689 14993 raft_consensus.cc:3037] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:57.773733 14993 raft_consensus.cc:504] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38227 } } peers { permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 } } peers { permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 } }
I20260808 08:33:57.774068 14993 leader_election.cc:288] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [CANDIDATE]: Term 1 election: Requested vote from peers 910fc676f0544b39899aefea2138e6ed (127.25.170.1:43195), 352e6987027b43f5bfb03f458cb620d2 (127.25.170.2:41205)
I20260808 08:33:57.774487 14780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c274475a5cc44c088ae64ea88d1cf51" candidate_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "352e6987027b43f5bfb03f458cb620d2"
I20260808 08:33:57.774587 14780 raft_consensus.cc:3037] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:57.775750 14780 raft_consensus.cc:2454] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3ca1cfd6fb4fa784dfad5f6e5ed21a in term 1.
I20260808 08:33:57.776062 14852 leader_election.cc:302] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 352e6987027b43f5bfb03f458cb620d2, 9b3ca1cfd6fb4fa784dfad5f6e5ed21a; no voters:
I20260808 08:33:57.776063 14640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c274475a5cc44c088ae64ea88d1cf51" candidate_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "910fc676f0544b39899aefea2138e6ed"
I20260808 08:33:57.776178 14640 raft_consensus.cc:3037] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:57.776238 14993 raft_consensus.cc:2781] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:57.776485 14993 raft_consensus.cc:686] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 1 LEADER]: Becoming Leader. State: Replica: 9b3ca1cfd6fb4fa784dfad5f6e5ed21a, State: Running, Role: LEADER
I20260808 08:33:57.776832 14993 consensus_queue.cc:237] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38227 } } peers { permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 } } peers { permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 } }
I20260808 08:33:57.777467 14640 raft_consensus.cc:2454] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b3ca1cfd6fb4fa784dfad5f6e5ed21a in term 1.
I20260808 08:33:57.780099 14491 catalog_manager.cc:5495] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b3ca1cfd6fb4fa784dfad5f6e5ed21a (127.25.170.3). New cstate: current_term: 1 leader_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b3ca1cfd6fb4fa784dfad5f6e5ed21a" member_type: VOTER last_known_addr { host: "127.25.170.3" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 } health_report { overall_health: UNKNOWN } } }
I20260808 08:33:57.797559 14981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.794410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36022 (local address 127.25.170.3:38227)
0808 08:33:57.794524 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:57.794527 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:57.794540 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:33:57.794635 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:57.794637 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:57.794687 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:57.794773 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:57.795002 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.795484 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.796368 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:57.796571 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:57.796641 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:57.796887 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:57.797269 (+ 382us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:57.797365 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:57.797418 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 08:33:57.797460 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 08:33:57.803221 14780 raft_consensus.cc:1261] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2 [term 1 FOLLOWER]: Refusing update from remote peer 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:57.803221 14640 raft_consensus.cc:1261] T 0c274475a5cc44c088ae64ea88d1cf51 P 910fc676f0544b39899aefea2138e6ed [term 1 FOLLOWER]: Refusing update from remote peer 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:57.803933 14993 consensus_queue.cc:1035] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [LEADER]: Connected to new peer: Peer: permanent_uuid: "352e6987027b43f5bfb03f458cb620d2" member_type: VOTER last_known_addr { host: "127.25.170.2" port: 41205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:57.804106 14996 consensus_queue.cc:1035] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [LEADER]: Connected to new peer: Peer: permanent_uuid: "910fc676f0544b39899aefea2138e6ed" member_type: VOTER last_known_addr { host: "127.25.170.1" port: 43195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:57.810771 14999 mvcc.cc:205] Tried to move back new op lower bound from 7316185242834804736 to 7316185242737283072. Current Snapshot: MvccSnapshot[applied={T|T < 7316185242834804736}]
I20260808 08:33:57.812518 15000 mvcc.cc:205] Tried to move back new op lower bound from 7316185242834804736 to 7316185242737283072. Current Snapshot: MvccSnapshot[applied={T|T < 7316185242834804736}]
I20260808 08:33:57.812882 15001 mvcc.cc:205] Tried to move back new op lower bound from 7316185242834804736 to 7316185242737283072. Current Snapshot: MvccSnapshot[applied={T|T < 7316185242834804736}]
I20260808 08:33:57.820756 14491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50068:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:57.820935 14491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50068:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:57.823283 14491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a4fe6b7d46b74af1941398096a6ea216: Sending DeleteTablet for 3 replicas of tablet 0c274475a5cc44c088ae64ea88d1cf51
I20260808 08:33:57.824079 14900 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c274475a5cc44c088ae64ea88d1cf51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:57 UTC) from {username='slave'} at 127.0.0.1:36018
I20260808 08:33:57.824167 14759 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c274475a5cc44c088ae64ea88d1cf51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:57 UTC) from {username='slave'} at 127.0.0.1:45410
I20260808 08:33:57.824653 15011 tablet_replica.cc:330] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: stopping tablet replica
I20260808 08:33:57.824745 14620 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c274475a5cc44c088ae64ea88d1cf51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:57 UTC) from {username='slave'} at 127.0.0.1:49780
I20260808 08:33:57.824952 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 14551
I20260808 08:33:57.824966 15011 raft_consensus.cc:2229] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:57.826772 15011 raft_consensus.cc:2258] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:57.828122 15010 tablet_replica.cc:330] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: stopping tablet replica
I20260808 08:33:57.828405 15010 raft_consensus.cc:2229] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:57.828604 15011 ts_tablet_manager.cc:1905] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:57.828779 15010 raft_consensus.cc:2258] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:57.830093 15010 ts_tablet_manager.cc:1905] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:57.831664 15011 ts_tablet_manager.cc:1918] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:57.831815 15011 log.cc:1196] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-1/wal/wals/0c274475a5cc44c088ae64ea88d1cf51
I20260808 08:33:57.832230 15011 ts_tablet_manager.cc:1939] T 0c274475a5cc44c088ae64ea88d1cf51 P 352e6987027b43f5bfb03f458cb620d2: Deleting consensus metadata
I20260808 08:33:57.832954 15010 ts_tablet_manager.cc:1918] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:57.833060 15010 log.cc:1196] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: Deleting WAL directory at /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786177786507378-26280-0/minicluster-data/ts-2/wal/wals/0c274475a5cc44c088ae64ea88d1cf51
I20260808 08:33:57.833379 15010 ts_tablet_manager.cc:1939] T 0c274475a5cc44c088ae64ea88d1cf51 P 9b3ca1cfd6fb4fa784dfad5f6e5ed21a: Deleting consensus metadata
I20260808 08:33:57.833787 14478 catalog_manager.cc:4841] TS 352e6987027b43f5bfb03f458cb620d2 (127.25.170.2:41205): tablet 0c274475a5cc44c088ae64ea88d1cf51 (table test-table [id=41b22b5c590f4a8aac1786a9553fa8dd]) successfully deleted
I20260808 08:33:57.834465 14475 catalog_manager.cc:4841] TS 9b3ca1cfd6fb4fa784dfad5f6e5ed21a (127.25.170.3:38227): tablet 0c274475a5cc44c088ae64ea88d1cf51 (table test-table [id=41b22b5c590f4a8aac1786a9553fa8dd]) successfully deleted
W20260808 08:33:57.834934 14478 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.170.1:43195 (error 108)
I20260808 08:33:57.835784 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 14690
I20260808 08:33:57.835961 14983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:57.835610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.1:43195 (local address 127.0.0.1:49782)
0808 08:33:57.835748 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:57.835832 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.1:43195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 08:33:57.837364 14478 catalog_manager.cc:4584] TS 910fc676f0544b39899aefea2138e6ed (127.25.170.1:43195): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0c274475a5cc44c088ae64ea88d1cf51: Network error: Client connection negotiation failed: client connection to 127.25.170.1:43195: connect: Connection refused (error 111)
I20260808 08:33:57.845314 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 14831
I20260808 08:33:57.851682 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 14460
2026-08-08T08:33:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1085 ms)
[----------] 6 tests from EncryptionPolicyTest (10417 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:57 dist-test-slave-zkpd krb5kdc[15015](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:57 dist-test-slave-zkpd krb5kdc[15015](info): set up 2 sockets
Aug 08 08:33:57 dist-test-slave-zkpd krb5kdc[15015](info): commencing operation
krb5kdc: starting...
W20260808 08:33:58.917584 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:33:59 dist-test-slave-zkpd krb5kdc[15015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:33:59.041113 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44535
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44535
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:59.151355 15030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:59.151662 15030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:59.151738 15030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:59.155731 15030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:59.155841 15030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:59.155881 15030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:59.155953 15030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:59.155994 15030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:59.161265 15030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44535
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:33:59.162429 15030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:59.163501 15030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:59.172122 15038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:59.172183 15035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:59.172276 15030 server_base.cc:1034] running on GCE node
W20260808 08:33:59.172113 15036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:59.172947 15030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:59.174027 15030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:59.175197 15030 hybrid_clock.cc:648] HybridClock initialized: now 1786178039175173 us; error 37 us; skew 500 ppm
Aug 08 08:33:59 dist-test-slave-zkpd krb5kdc[15015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178039, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:59.177985 15030 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:33:59.178978 15030 webserver.cc:460] Webserver started at http://127.0.0.1:41091/ using document root <none> and password file <none>
I20260808 08:33:59.179543 15030 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:59.179636 15030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:59.179865 15030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:59.181906 15030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "dd77e3778fe54f328cb9250dd3681407"
format_stamp: "Formatted at 2026-08-08 08:33:59 on dist-test-slave-zkpd"
server_key: "d086c7bcf265301513de1bb3def030f1"
server_key_iv: "386a5265902a122e8924bedb74a91c6f"
server_key_version: "encryptionkey@0"
I20260808 08:33:59.182499 15030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "dd77e3778fe54f328cb9250dd3681407"
format_stamp: "Formatted at 2026-08-08 08:33:59 on dist-test-slave-zkpd"
server_key: "d086c7bcf265301513de1bb3def030f1"
server_key_iv: "386a5265902a122e8924bedb74a91c6f"
server_key_version: "encryptionkey@0"
I20260808 08:33:59.186146 15030 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:33:59.188666 15045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:59.189817 15030 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:33:59.189967 15030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "dd77e3778fe54f328cb9250dd3681407"
format_stamp: "Formatted at 2026-08-08 08:33:59 on dist-test-slave-zkpd"
server_key: "d086c7bcf265301513de1bb3def030f1"
server_key_iv: "386a5265902a122e8924bedb74a91c6f"
server_key_version: "encryptionkey@0"
I20260808 08:33:59.190078 15030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:59.200321 15030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:59.202899 15030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:59.203086 15030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:59.210286 15030 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44535
I20260808 08:33:59.210315 15099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44535 every 8 connection(s)
I20260808 08:33:59.211223 15030 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:59.213914 15100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:59.217284 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 15030
I20260808 08:33:59.217456 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:33:59.217733 26280 external_mini_cluster.cc:1428] Setting key faaced96d84f1a3f39f43199f4da1adb
I20260808 08:33:59.219579 15100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407: Bootstrap starting.
I20260808 08:33:59.221731 15100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:59.222488 15100 log.cc:824] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:59.224308 15100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407: No bootstrap required, opened a new log
Aug 08 08:33:59 dist-test-slave-zkpd krb5kdc[15015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:33:59.227723 15100 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd77e3778fe54f328cb9250dd3681407" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44535 } }
I20260808 08:33:59.228005 15100 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:59.228082 15100 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd77e3778fe54f328cb9250dd3681407, State: Initialized, Role: FOLLOWER
I20260808 08:33:59.228585 15100 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd77e3778fe54f328cb9250dd3681407" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44535 } }
I20260808 08:33:59.228741 15100 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:59.228819 15100 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:59.228926 15100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:59.229961 15100 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd77e3778fe54f328cb9250dd3681407" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44535 } }
I20260808 08:33:59.230302 15100 leader_election.cc:302] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd77e3778fe54f328cb9250dd3681407; no voters:
I20260808 08:33:59.230592 15100 leader_election.cc:288] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:59.230697 15105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:59.230953 15105 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [term 1 LEADER]: Becoming Leader. State: Replica: dd77e3778fe54f328cb9250dd3681407, State: Running, Role: LEADER
I20260808 08:33:59.231343 15105 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd77e3778fe54f328cb9250dd3681407" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44535 } }
I20260808 08:33:59.231832 15100 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:59.232610 15105 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd77e3778fe54f328cb9250dd3681407. Latest consensus state: current_term: 1 leader_uuid: "dd77e3778fe54f328cb9250dd3681407" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd77e3778fe54f328cb9250dd3681407" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44535 } } }
I20260808 08:33:59.232800 15105 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:59.232852 15103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:59.219122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58769 (local address 127.0.0.1:44535)
0808 08:33:59.219565 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:59.219579 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:59.219614 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:33:59.220345 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:59.220363 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:59.220684 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:59.221022 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:59.221852 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.222906 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.223790 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.224320 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.224495 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:59.227054 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:59.227059 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:59.227071 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:59.227097 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:59.229149 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:59.229654 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:59.229660 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:59.229666 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:59.229819 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:59.230155 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:59.230159 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:59.230163 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:59.230619 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:59.231460 (+ 841us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:59.231640 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 08:33:59.231877 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":146,"threads_started":1}
I20260808 08:33:59.233052 15106 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd77e3778fe54f328cb9250dd3681407" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd77e3778fe54f328cb9250dd3681407" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44535 } } }
I20260808 08:33:59.233234 15106 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:59.233232 15115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:59.236384 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:33:59.236545 15115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:59.242041 15115 catalog_manager.cc:1347] Generated new cluster ID: 59b9630562454d3aa54e6e3c758c73aa
I20260808 08:33:59.242139 15115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:59.248847 15115 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:59.250023 15115 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:59.250190 15103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:59.240340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48385 (local address 127.0.0.1:44535)
0808 08:33:59.240458 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:59.240465 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:59.240780 (+ 315us) server_negotiation.cc:407] Connection header received
0808 08:33:59.240962 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:59.240964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:59.241012 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:59.241098 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:59.242264 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.243075 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.244269 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.244615 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.244710 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:59.246378 (+ 1668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:59.246382 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:59.246385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:59.246410 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:59.248093 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:59.248662 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:59.248666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:59.248668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:59.248753 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:59.249259 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:59.249262 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:59.249264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:59.249454 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:59.249593 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:59.249896 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 08:33:59.249994 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":42}
I20260808 08:33:59.256583 15115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd77e3778fe54f328cb9250dd3681407: Generated new TSK 0
I20260808 08:33:59.257285 15115 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:33:59.260474 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 15030
W20260808 08:33:59.268558 15013 connection.cc:535] client connection to 127.0.0.1:44535 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44535): Connection reset by peer (error 104)
2026-08-08T08:33:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:59 dist-test-slave-zkpd krb5kdc[15135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:59 dist-test-slave-zkpd krb5kdc[15135](info): set up 2 sockets
Aug 08 08:33:59 dist-test-slave-zkpd krb5kdc[15135](info): commencing operation
krb5kdc: starting...
W20260808 08:34:00.342124 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:00 dist-test-slave-zkpd krb5kdc[15135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:00.465178 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35019
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:00.588017 15148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:00.588300 15148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:00.588413 15148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:00.593740 15148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:00.593827 15148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:00.593863 15148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:00.593899 15148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:00.593932 15148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:00.599191 15148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35019
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:00.600289 15148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:00.601308 15148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:00.609745 15154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:00.609777 15155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:00.609861 15148 server_base.cc:1034] running on GCE node
W20260808 08:34:00.610086 15157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:00.610654 15148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:00.611712 15148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:00.612905 15148 hybrid_clock.cc:648] HybridClock initialized: now 1786178040612896 us; error 60 us; skew 500 ppm
Aug 08 08:34:00 dist-test-slave-zkpd krb5kdc[15135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178040, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:00.615563 15148 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:00.616505 15148 webserver.cc:460] Webserver started at http://127.0.0.1:33235/ using document root <none> and password file <none>
I20260808 08:34:00.617076 15148 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:00.617166 15148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:00.617398 15148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:00.619441 15148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43"
format_stamp: "Formatted at 2026-08-08 08:34:00 on dist-test-slave-zkpd"
server_key: "621b9c1a8351ed7b2b22fd84132b966d"
server_key_iv: "3ac101a072c413a146f2834c7eded890"
server_key_version: "encryptionkey@0"
I20260808 08:34:00.620074 15148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43"
format_stamp: "Formatted at 2026-08-08 08:34:00 on dist-test-slave-zkpd"
server_key: "621b9c1a8351ed7b2b22fd84132b966d"
server_key_iv: "3ac101a072c413a146f2834c7eded890"
server_key_version: "encryptionkey@0"
I20260808 08:34:00.623677 15148 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:00.626065 15165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:00.627260 15148 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:34:00.627403 15148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43"
format_stamp: "Formatted at 2026-08-08 08:34:00 on dist-test-slave-zkpd"
server_key: "621b9c1a8351ed7b2b22fd84132b966d"
server_key_iv: "3ac101a072c413a146f2834c7eded890"
server_key_version: "encryptionkey@0"
I20260808 08:34:00.627511 15148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:00.656440 15148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:00.659221 15148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:00.659430 15148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:00.666512 15148 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35019
I20260808 08:34:00.666540 15220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35019 every 8 connection(s)
I20260808 08:34:00.667430 15148 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:00.670143 15221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:00.671262 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 15148
I20260808 08:34:00.671424 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:00.671723 26280 external_mini_cluster.cc:1428] Setting key 4831b630a97bc7510108d7ae3901bc47
I20260808 08:34:00.676944 15221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43: Bootstrap starting.
I20260808 08:34:00.679469 15221 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:00.680400 15221 log.cc:824] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:00.681768 15224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:00.673213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48109 (local address 127.0.0.1:35019)
0808 08:34:00.673637 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:00.673656 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:00.673717 (+ 61us) server_negotiation.cc:407] Connection header received
0808 08:34:00.674548 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:00.674571 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:00.675000 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:00.675375 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:00.675796 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.677251 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.678115 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.678790 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.678945 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:00.679820 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:00.679827 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:00.679842 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:00.680362 (+ 520us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:00.680429 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:00.680471 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:00.680607 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:00.680799 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 08:34:00.680932 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":101,"threads_started":1}
I20260808 08:34:00.682543 15221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43: No bootstrap required, opened a new log
I20260808 08:34:00.684909 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:00.687172 15221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35019 } }
I20260808 08:34:00.687462 15221 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:00.687532 15221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c38bc0ab77c4cbcbb1fdb0a1825fa43, State: Initialized, Role: FOLLOWER
I20260808 08:34:00.688045 15221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35019 } }
I20260808 08:34:00.688226 15221 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:00.688297 15221 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:00.688396 15221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:00.689405 15221 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35019 } }
I20260808 08:34:00.689781 15221 leader_election.cc:302] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c38bc0ab77c4cbcbb1fdb0a1825fa43; no voters:
I20260808 08:34:00.690109 15221 leader_election.cc:288] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:00.690227 15231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:00.690488 15231 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [term 1 LEADER]: Becoming Leader. State: Replica: 3c38bc0ab77c4cbcbb1fdb0a1825fa43, State: Running, Role: LEADER
I20260808 08:34:00.691220 15231 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35019 } }
I20260808 08:34:00.691450 15221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:00.691594 15224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:00.687159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48831 (local address 127.0.0.1:35019)
0808 08:34:00.687286 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:00.687291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:00.687467 (+ 176us) server_negotiation.cc:407] Connection header received
0808 08:34:00.687623 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:00.687626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:00.687670 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:00.687741 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:00.688135 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.688859 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.689710 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.690042 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.690168 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:00.691069 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:00.691073 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:00.691076 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:00.691088 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:00.691114 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:00.691127 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:00.691219 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:00.691421 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 08:34:00.691454 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:34:00.693409 15233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c38bc0ab77c4cbcbb1fdb0a1825fa43. Latest consensus state: current_term: 1 leader_uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35019 } } }
I20260808 08:34:00.693445 15232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c38bc0ab77c4cbcbb1fdb0a1825fa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35019 } } }
I20260808 08:34:00.693537 15233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:00.693557 15232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43 [sys.catalog]: This master's current role is: LEADER
W20260808 08:34:00.696439 15246 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:00.696503 15246 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:00.696580 15247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:00.697274 15247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:00.703094 15247 catalog_manager.cc:1347] Generated new cluster ID: 1a8108be17824530bdf2c828e79d92af
I20260808 08:34:00.703168 15247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:00.727749 15247 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:00.728681 15247 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:00.737178 15247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c38bc0ab77c4cbcbb1fdb0a1825fa43: Generated new TSK 0
I20260808 08:34:00.737847 15247 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:00.746943 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 15148
W20260808 08:34:00.755807 15133 connection.cc:535] client connection to 127.0.0.1:35019 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35019): Connection reset by peer (error 104)
2026-08-08T08:34:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1487 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:00 dist-test-slave-zkpd krb5kdc[15253](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:00 dist-test-slave-zkpd krb5kdc[15253](info): set up 2 sockets
Aug 08 08:34:00 dist-test-slave-zkpd krb5kdc[15253](info): commencing operation
krb5kdc: starting...
W20260808 08:34:01.814563 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:01 dist-test-slave-zkpd krb5kdc[15253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:01.939031 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34111
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:02.051509 15267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:02.051792 15267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:02.051868 15267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:02.055748 15267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:02.055841 15267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:02.055881 15267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:02.055962 15267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:02.056017 15267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:02.060927 15267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34111
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:02.061878 15267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:02.062815 15267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:02.071190 15275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:02.071187 15273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:02.071183 15272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:02.071611 15267 server_base.cc:1034] running on GCE node
I20260808 08:34:02.072228 15267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:02.073268 15267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:02.074461 15267 hybrid_clock.cc:648] HybridClock initialized: now 1786178042074429 us; error 43 us; skew 500 ppm
Aug 08 08:34:02 dist-test-slave-zkpd krb5kdc[15253](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178042, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:02.077303 15267 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:02.078161 15267 webserver.cc:460] Webserver started at http://127.0.0.1:38003/ using document root <none> and password file <none>
I20260808 08:34:02.078701 15267 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:02.078787 15267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:02.079020 15267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:02.081081 15267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "49378bbdbfd3498386ce0068eafac2ba"
format_stamp: "Formatted at 2026-08-08 08:34:02 on dist-test-slave-zkpd"
server_key: "3c75fc776ed6a97bd4deb90cc05328ce"
server_key_iv: "ac340883589c61f0b155eb8742c9ca5f"
server_key_version: "encryptionkey@0"
I20260808 08:34:02.081631 15267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "49378bbdbfd3498386ce0068eafac2ba"
format_stamp: "Formatted at 2026-08-08 08:34:02 on dist-test-slave-zkpd"
server_key: "3c75fc776ed6a97bd4deb90cc05328ce"
server_key_iv: "ac340883589c61f0b155eb8742c9ca5f"
server_key_version: "encryptionkey@0"
I20260808 08:34:02.085356 15267 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:34:02.087695 15282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:02.088950 15267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:34:02.089087 15267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "49378bbdbfd3498386ce0068eafac2ba"
format_stamp: "Formatted at 2026-08-08 08:34:02 on dist-test-slave-zkpd"
server_key: "3c75fc776ed6a97bd4deb90cc05328ce"
server_key_iv: "ac340883589c61f0b155eb8742c9ca5f"
server_key_version: "encryptionkey@0"
I20260808 08:34:02.089191 15267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:02.093667 15267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:02.096962 15267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:02.097151 15267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:02.104257 15267 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34111
I20260808 08:34:02.104269 15341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34111 every 8 connection(s)
I20260808 08:34:02.105238 15267 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:02.108038 15342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:02.113557 15342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba: Bootstrap starting.
I20260808 08:34:02.115082 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 15267
I20260808 08:34:02.115259 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:02.115545 26280 external_mini_cluster.cc:1428] Setting key 165fd65d44fc8351fef49326ea7902e4
I20260808 08:34:02.116246 15342 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:02.117126 15342 log.cc:824] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:02.119340 15342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba: No bootstrap required, opened a new log
I20260808 08:34:02.121001 15345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:02.116728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42831 (local address 127.0.0.1:34111)
0808 08:34:02.117246 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:02.117265 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:02.117307 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:34:02.118138 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:02.118162 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:02.118518 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:02.118876 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:02.119620 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:02.119627 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:02.119641 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:02.119653 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:02.119724 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:02.119753 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:02.119865 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:02.119969 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 08:34:02.120120 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":126,"threads_started":1}
I20260808 08:34:02.123750 15342 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49378bbdbfd3498386ce0068eafac2ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260808 08:34:02.123987 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:02.124046 15342 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:02.124135 15342 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49378bbdbfd3498386ce0068eafac2ba, State: Initialized, Role: FOLLOWER
I20260808 08:34:02.124588 15342 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49378bbdbfd3498386ce0068eafac2ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260808 08:34:02.124711 15342 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:02.124800 15342 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:02.124907 15342 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:02.125869 15342 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49378bbdbfd3498386ce0068eafac2ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260808 08:34:02.126256 15342 leader_election.cc:302] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49378bbdbfd3498386ce0068eafac2ba; no voters:
I20260808 08:34:02.126605 15342 leader_election.cc:288] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:02.126691 15354 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:02.126965 15354 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [term 1 LEADER]: Becoming Leader. State: Replica: 49378bbdbfd3498386ce0068eafac2ba, State: Running, Role: LEADER
I20260808 08:34:02.127627 15354 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49378bbdbfd3498386ce0068eafac2ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } }
I20260808 08:34:02.127967 15345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:02.126137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42177 (local address 127.0.0.1:34111)
0808 08:34:02.126286 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:02.126291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:02.126494 (+ 203us) server_negotiation.cc:407] Connection header received
0808 08:34:02.126642 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:02.126645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:02.126683 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:02.126769 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:02.127539 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:02.127542 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:02.127544 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:02.127557 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:02.127585 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:02.127599 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:02.127686 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:02.127789 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 08:34:02.127825 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:34:02.127942 15342 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:02.129387 15356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49378bbdbfd3498386ce0068eafac2ba. Latest consensus state: current_term: 1 leader_uuid: "49378bbdbfd3498386ce0068eafac2ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49378bbdbfd3498386ce0068eafac2ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } } }
I20260808 08:34:02.129510 15356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:02.129878 15355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49378bbdbfd3498386ce0068eafac2ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49378bbdbfd3498386ce0068eafac2ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34111 } } }
I20260808 08:34:02.129940 15365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:02.129974 15355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:02.132990 15365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:02.137727 15365 catalog_manager.cc:1347] Generated new cluster ID: 701044f9c87d4712b0c10613ed83bc63
I20260808 08:34:02.137787 15365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:02.153010 15365 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:02.153302 15365 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:02.160509 15365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49378bbdbfd3498386ce0068eafac2ba: Generated new TSK 0
I20260808 08:34:02.161168 15365 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:02.169785 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 15267
2026-08-08T08:34:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1421 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:02 dist-test-slave-zkpd krb5kdc[15375](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:02 dist-test-slave-zkpd krb5kdc[15375](info): set up 2 sockets
Aug 08 08:34:02 dist-test-slave-zkpd krb5kdc[15375](info): commencing operation
krb5kdc: starting...
W20260808 08:34:03.269492 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:03 dist-test-slave-zkpd krb5kdc[15375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:03.397308 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38677
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:03.512799 15388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:03.513028 15388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:03.513067 15388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:03.516894 15388 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:03.516948 15388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:03.516966 15388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:03.516981 15388 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:03.516996 15388 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:03.522019 15388 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:03.522908 15388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:03.523825 15388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:03.532011 15394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:03.532156 15388 server_base.cc:1034] running on GCE node
W20260808 08:34:03.532006 15393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:03.532027 15396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:03.532799 15388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:03.533855 15388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:03.535014 15388 hybrid_clock.cc:648] HybridClock initialized: now 1786178043534990 us; error 35 us; skew 500 ppm
Aug 08 08:34:03 dist-test-slave-zkpd krb5kdc[15375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178043, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:03.542055 15388 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:03.542941 15388 webserver.cc:460] Webserver started at http://127.0.0.1:42383/ using document root <none> and password file <none>
I20260808 08:34:03.543496 15388 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:03.543589 15388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:03.543823 15388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:03.545802 15388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "38f8b010363b44bba71cd0107ebd0d56"
format_stamp: "Formatted at 2026-08-08 08:34:03 on dist-test-slave-zkpd"
server_key: "3ed41f5d7e7d342eb6be866e4561910a"
server_key_iv: "89d4300c8f066838003022e5e09c9d21"
server_key_version: "encryptionkey@0"
I20260808 08:34:03.546432 15388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "38f8b010363b44bba71cd0107ebd0d56"
format_stamp: "Formatted at 2026-08-08 08:34:03 on dist-test-slave-zkpd"
server_key: "3ed41f5d7e7d342eb6be866e4561910a"
server_key_iv: "89d4300c8f066838003022e5e09c9d21"
server_key_version: "encryptionkey@0"
I20260808 08:34:03.550089 15388 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:34:03.552484 15403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:03.553643 15388 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:34:03.553803 15388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "38f8b010363b44bba71cd0107ebd0d56"
format_stamp: "Formatted at 2026-08-08 08:34:03 on dist-test-slave-zkpd"
server_key: "3ed41f5d7e7d342eb6be866e4561910a"
server_key_iv: "89d4300c8f066838003022e5e09c9d21"
server_key_version: "encryptionkey@0"
I20260808 08:34:03.553917 15388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:03.565311 15388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:03.568148 15388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:03.568370 15388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:03.575708 15388 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38677
I20260808 08:34:03.575729 15460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38677 every 8 connection(s)
I20260808 08:34:03.576788 15388 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:03.579469 15461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:03.584486 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 15388
I20260808 08:34:03.584640 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:03.584937 26280 external_mini_cluster.cc:1428] Setting key 14fe357754571e049c94ac446f4bbb20
I20260808 08:34:03.585175 15461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56: Bootstrap starting.
I20260808 08:34:03.587592 15461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:03.588498 15461 log.cc:824] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:03.590634 15461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56: No bootstrap required, opened a new log
Aug 08 08:34:03 dist-test-slave-zkpd krb5kdc[15375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:34:03.595105 15461 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38f8b010363b44bba71cd0107ebd0d56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38677 } }
I20260808 08:34:03.595376 15461 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:03.595458 15461 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38f8b010363b44bba71cd0107ebd0d56, State: Initialized, Role: FOLLOWER
I20260808 08:34:03.596002 15461 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38f8b010363b44bba71cd0107ebd0d56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38677 } }
I20260808 08:34:03.596158 15461 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:03.596225 15461 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:03.596321 15461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:03.597227 15461 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38f8b010363b44bba71cd0107ebd0d56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38677 } }
I20260808 08:34:03.597573 15461 leader_election.cc:302] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38f8b010363b44bba71cd0107ebd0d56; no voters:
I20260808 08:34:03.597950 15461 leader_election.cc:288] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:03.598043 15466 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:03.598253 15466 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [term 1 LEADER]: Becoming Leader. State: Replica: 38f8b010363b44bba71cd0107ebd0d56, State: Running, Role: LEADER
I20260808 08:34:03.598567 15466 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38f8b010363b44bba71cd0107ebd0d56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38677 } }
I20260808 08:34:03.599301 15461 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:03.600246 15464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:03.586258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57311 (local address 127.0.0.1:38677)
0808 08:34:03.586722 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:03.586738 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:03.586772 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:34:03.587401 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:03.587417 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:03.587800 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:03.588191 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:03.589058 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.590493 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.591400 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.592107 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.592277 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:03.594935 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:03.594940 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:03.594953 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:03.594978 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:03.596903 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:03.597420 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:03.597426 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:03.597431 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:03.597550 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:03.597857 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:03.597860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:03.597861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:03.598425 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:03.598647 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:03.598938 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 08:34:03.599220 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":143,"threads_started":1}
I20260808 08:34:03.600334 15467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38f8b010363b44bba71cd0107ebd0d56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38f8b010363b44bba71cd0107ebd0d56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38677 } } }
I20260808 08:34:03.600355 15468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38f8b010363b44bba71cd0107ebd0d56. Latest consensus state: current_term: 1 leader_uuid: "38f8b010363b44bba71cd0107ebd0d56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38f8b010363b44bba71cd0107ebd0d56" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38677 } } }
I20260808 08:34:03.600471 15467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:03.600471 15468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:03.600818 15476 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:03.603776 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:03.603947 15476 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:03.609701 15476 catalog_manager.cc:1347] Generated new cluster ID: 9f8f5be2cfac46bc933fb7ac8be7675e
I20260808 08:34:03.609757 15476 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:03.614239 15464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:03.606202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50137 (local address 127.0.0.1:38677)
0808 08:34:03.606293 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:03.606297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:03.606312 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:34:03.606347 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:03.606350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:03.606387 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:03.606469 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:03.607260 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.607852 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.608828 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.609083 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.609196 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:03.610672 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:03.610677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:03.610683 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:03.610710 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:03.612537 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:03.612978 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:03.612981 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:03.612983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:03.613066 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:03.613365 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:03.613368 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:03.613370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:03.613548 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:03.613683 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:03.613947 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 08:34:03.614061 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 08:34:03.634722 15476 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:03.635979 15476 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:03.642489 15476 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38f8b010363b44bba71cd0107ebd0d56: Generated new TSK 0
I20260808 08:34:03.643163 15476 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:03.650270 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 15388
2026-08-08T08:34:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1481 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:03 dist-test-slave-zkpd krb5kdc[15493](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:03 dist-test-slave-zkpd krb5kdc[15493](info): set up 2 sockets
Aug 08 08:34:03 dist-test-slave-zkpd krb5kdc[15493](info): commencing operation
krb5kdc: starting...
W20260808 08:34:04.709679 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:04 dist-test-slave-zkpd krb5kdc[15493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:04.834759 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34229
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:04.944197 15507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:04.944482 15507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:04.944559 15507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:04.948537 15507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:04.948624 15507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:04.948661 15507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:04.948696 15507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:04.948731 15507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:04.953830 15507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:04.954820 15507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:04.955811 15507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:04.964340 15513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:04.964341 15512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:04.964504 15507 server_base.cc:1034] running on GCE node
W20260808 08:34:04.964341 15516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:04.965313 15507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:04.966339 15507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:04.967512 15507 hybrid_clock.cc:648] HybridClock initialized: now 1786178044967483 us; error 39 us; skew 500 ppm
Aug 08 08:34:04 dist-test-slave-zkpd krb5kdc[15493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178044, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:04.970508 15507 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:04.971400 15507 webserver.cc:460] Webserver started at http://127.0.0.1:41303/ using document root <none> and password file <none>
I20260808 08:34:04.972018 15507 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:04.972091 15507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:04.972328 15507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:04.974395 15507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "e62260f9d13f490a8276ac3d15bb9e16"
format_stamp: "Formatted at 2026-08-08 08:34:04 on dist-test-slave-zkpd"
server_key: "c3664f5c586e0308636af55847792eed"
server_key_iv: "32d4aefa05aca3b9cb081666b658c260"
server_key_version: "encryptionkey@0"
I20260808 08:34:04.974967 15507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "e62260f9d13f490a8276ac3d15bb9e16"
format_stamp: "Formatted at 2026-08-08 08:34:04 on dist-test-slave-zkpd"
server_key: "c3664f5c586e0308636af55847792eed"
server_key_iv: "32d4aefa05aca3b9cb081666b658c260"
server_key_version: "encryptionkey@0"
I20260808 08:34:04.978619 15507 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:34:04.981009 15524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:04.982224 15507 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:34:04.982376 15507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "e62260f9d13f490a8276ac3d15bb9e16"
format_stamp: "Formatted at 2026-08-08 08:34:04 on dist-test-slave-zkpd"
server_key: "c3664f5c586e0308636af55847792eed"
server_key_iv: "32d4aefa05aca3b9cb081666b658c260"
server_key_version: "encryptionkey@0"
I20260808 08:34:04.982486 15507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:05.001317 15507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:05.004726 15507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:05.004951 15507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:05.012133 15507 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34229
I20260808 08:34:05.012161 15580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34229 every 8 connection(s)
I20260808 08:34:05.013116 15507 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:05.015861 15581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:05.020875 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 15507
I20260808 08:34:05.021026 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:05.021307 26280 external_mini_cluster.cc:1428] Setting key e94c6576724429224940df726d5304c7
I20260808 08:34:05.021641 15581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16: Bootstrap starting.
I20260808 08:34:05.024442 15581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:05.025382 15581 log.cc:824] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:05.027539 15581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16: No bootstrap required, opened a new log
I20260808 08:34:05.031550 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:05.022788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49231 (local address 127.0.0.1:34229)
0808 08:34:05.023218 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:05.023239 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:05.023281 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:34:05.024138 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:05.024162 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:05.024611 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:05.025007 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:05.025449 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:05.026797 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:05.027800 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:05.028504 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:05.028669 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:05.029463 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:05.029471 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:05.029487 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:05.029993 (+ 506us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:05.030061 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:05.030090 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:05.030200 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:05.030303 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 08:34:05.030555 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":112,"threads_started":1}
I20260808 08:34:05.032151 15581 raft_consensus.cc:348] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62260f9d13f490a8276ac3d15bb9e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34229 } }
I20260808 08:34:05.032401 15581 raft_consensus.cc:374] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:05.032483 15581 raft_consensus.cc:729] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e62260f9d13f490a8276ac3d15bb9e16, State: Initialized, Role: FOLLOWER
I20260808 08:34:05.032922 15581 consensus_queue.cc:260] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62260f9d13f490a8276ac3d15bb9e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34229 } }
I20260808 08:34:05.033085 15581 raft_consensus.cc:388] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:05.033174 15581 raft_consensus.cc:482] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:05.033277 15581 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:05.034363 15581 raft_consensus.cc:504] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62260f9d13f490a8276ac3d15bb9e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34229 } }
I20260808 08:34:05.034570 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:05.034734 15581 leader_election.cc:302] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e62260f9d13f490a8276ac3d15bb9e16; no voters:
I20260808 08:34:05.035054 15581 leader_election.cc:288] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:05.035174 15586 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:05.035426 15586 raft_consensus.cc:686] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [term 1 LEADER]: Becoming Leader. State: Replica: e62260f9d13f490a8276ac3d15bb9e16, State: Running, Role: LEADER
I20260808 08:34:05.035785 15586 consensus_queue.cc:237] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62260f9d13f490a8276ac3d15bb9e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34229 } }
I20260808 08:34:05.036552 15581 sys_catalog.cc:564] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:05.037400 15588 sys_catalog.cc:455] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e62260f9d13f490a8276ac3d15bb9e16. Latest consensus state: current_term: 1 leader_uuid: "e62260f9d13f490a8276ac3d15bb9e16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62260f9d13f490a8276ac3d15bb9e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34229 } } }
I20260808 08:34:05.037554 15588 sys_catalog.cc:458] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:05.037900 15587 sys_catalog.cc:455] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e62260f9d13f490a8276ac3d15bb9e16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e62260f9d13f490a8276ac3d15bb9e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34229 } } }
I20260808 08:34:05.038003 15587 sys_catalog.cc:458] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16 [sys.catalog]: This master's current role is: LEADER
W20260808 08:34:05.041761 15607 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:05.041893 15607 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:05.041997 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:05.036923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52435 (local address 127.0.0.1:34229)
0808 08:34:05.037032 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:05.037036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:05.037538 (+ 502us) server_negotiation.cc:407] Connection header received
0808 08:34:05.037744 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:05.037747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:05.037822 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:05.037894 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:05.038331 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:05.039060 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:05.040187 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:05.040503 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:05.040610 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:05.041490 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:05.041494 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:05.041496 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:05.041510 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:05.041538 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:05.041551 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:05.041630 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:05.041763 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 08:34:05.041817 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 08:34:05.042032 15601 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:05.042904 15601 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:05.048444 15601 catalog_manager.cc:1347] Generated new cluster ID: c99eb1383b124398ae667156c428bdac
I20260808 08:34:05.048507 15601 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:05.071030 15601 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:05.072048 15601 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:05.081239 15601 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e62260f9d13f490a8276ac3d15bb9e16: Generated new TSK 0
I20260808 08:34:05.081928 15601 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:05.087152 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 15507
2026-08-08T08:34:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1435 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:05 dist-test-slave-zkpd krb5kdc[15613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:05 dist-test-slave-zkpd krb5kdc[15613](info): set up 2 sockets
Aug 08 08:34:05 dist-test-slave-zkpd krb5kdc[15613](info): commencing operation
krb5kdc: starting...
W20260808 08:34:06.161787 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:06 dist-test-slave-zkpd krb5kdc[15613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:06.285094 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43239
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:06.395545 15628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:06.395808 15628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:06.395850 15628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:06.399804 15628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:06.399863 15628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:06.399883 15628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:06.399957 15628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:06.399974 15628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:06.405097 15628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:06.406036 15628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:06.406980 15628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:06.415783 15633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:06.415803 15636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:06.415784 15634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:06.416142 15628 server_base.cc:1034] running on GCE node
I20260808 08:34:06.416690 15628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:06.417752 15628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:06.418915 15628 hybrid_clock.cc:648] HybridClock initialized: now 1786178046418891 us; error 36 us; skew 500 ppm
Aug 08 08:34:06 dist-test-slave-zkpd krb5kdc[15613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178046, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:06.421682 15628 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:06.422535 15628 webserver.cc:460] Webserver started at http://127.0.0.1:45967/ using document root <none> and password file <none>
I20260808 08:34:06.423079 15628 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:06.423139 15628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:06.423393 15628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:06.425473 15628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "7003e59a630646078f20b676459c6469"
format_stamp: "Formatted at 2026-08-08 08:34:06 on dist-test-slave-zkpd"
server_key: "b7ebc557956dd4883d5e29f131a6c34d"
server_key_iv: "137e210cbab8bce5c77a045f1cae1b6f"
server_key_version: "encryptionkey@0"
I20260808 08:34:06.426044 15628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "7003e59a630646078f20b676459c6469"
format_stamp: "Formatted at 2026-08-08 08:34:06 on dist-test-slave-zkpd"
server_key: "b7ebc557956dd4883d5e29f131a6c34d"
server_key_iv: "137e210cbab8bce5c77a045f1cae1b6f"
server_key_version: "encryptionkey@0"
I20260808 08:34:06.429698 15628 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:34:06.432004 15644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:06.433203 15628 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:34:06.433342 15628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "7003e59a630646078f20b676459c6469"
format_stamp: "Formatted at 2026-08-08 08:34:06 on dist-test-slave-zkpd"
server_key: "b7ebc557956dd4883d5e29f131a6c34d"
server_key_iv: "137e210cbab8bce5c77a045f1cae1b6f"
server_key_version: "encryptionkey@0"
I20260808 08:34:06.433452 15628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:06.437968 15628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:06.440757 15628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:06.440954 15628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:06.447917 15628 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43239
I20260808 08:34:06.447939 15704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43239 every 8 connection(s)
I20260808 08:34:06.448837 15628 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:06.451148 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 15628
I20260808 08:34:06.451294 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:06.451650 26280 external_mini_cluster.cc:1428] Setting key 9dc1ef7dbf47fea2177403db1b8ce967
I20260808 08:34:06.451792 15705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:06.457070 15708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:06.453038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40811 (local address 127.0.0.1:43239)
0808 08:34:06.453474 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:06.453488 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:06.453522 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:34:06.454482 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:06.454500 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:06.454765 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:06.455087 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:06.455868 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:06.455873 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:06.455931 (+ 58us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:06.455946 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:06.456013 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:06.456035 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:06.456182 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:06.456254 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 08:34:06.456415 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":144,"threads_started":1}
I20260808 08:34:06.458549 15705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469: Bootstrap starting.
I20260808 08:34:06.459880 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:06.461089 15705 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:06.461889 15705 log.cc:824] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:06.463547 15708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:06.461900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56789 (local address 127.0.0.1:43239)
0808 08:34:06.462027 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:06.462031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:06.462261 (+ 230us) server_negotiation.cc:407] Connection header received
0808 08:34:06.462390 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:06.462392 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:06.462418 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:06.462483 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:06.463192 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:06.463195 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:06.463198 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:06.463209 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:06.463235 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:06.463247 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:06.463343 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:06.463409 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 08:34:06.463445 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:34:06.464201 15705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469: No bootstrap required, opened a new log
I20260808 08:34:06.467559 15705 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7003e59a630646078f20b676459c6469" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } }
I20260808 08:34:06.467761 15705 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:06.467795 15705 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7003e59a630646078f20b676459c6469, State: Initialized, Role: FOLLOWER
I20260808 08:34:06.468202 15705 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7003e59a630646078f20b676459c6469" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } }
I20260808 08:34:06.468319 15705 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:06.468366 15705 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:06.468434 15705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:06.469300 15705 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7003e59a630646078f20b676459c6469" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } }
I20260808 08:34:06.469632 15705 leader_election.cc:302] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7003e59a630646078f20b676459c6469; no voters:
I20260808 08:34:06.469925 15705 leader_election.cc:288] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:06.470067 15715 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:06.470288 15715 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [term 1 LEADER]: Becoming Leader. State: Replica: 7003e59a630646078f20b676459c6469, State: Running, Role: LEADER
I20260808 08:34:06.470670 15715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7003e59a630646078f20b676459c6469" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } }
I20260808 08:34:06.471122 15705 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:06.472522 15717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7003e59a630646078f20b676459c6469. Latest consensus state: current_term: 1 leader_uuid: "7003e59a630646078f20b676459c6469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7003e59a630646078f20b676459c6469" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } } }
I20260808 08:34:06.472654 15716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7003e59a630646078f20b676459c6469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7003e59a630646078f20b676459c6469" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } } }
I20260808 08:34:06.472715 15717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:06.472810 15716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:06.473235 15728 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:06.475981 15728 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:06.481312 15728 catalog_manager.cc:1347] Generated new cluster ID: 5a38a3c92ced4adaa5645af554fe2add
I20260808 08:34:06.481405 15728 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:06.505599 15728 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:06.505927 15728 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:06.519418 15728 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7003e59a630646078f20b676459c6469: Generated new TSK 0
I20260808 08:34:06.520198 15728 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:06.527732 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 15628
2026-08-08T08:34:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1440 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:06 dist-test-slave-zkpd krb5kdc[15738](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:06 dist-test-slave-zkpd krb5kdc[15738](info): set up 2 sockets
Aug 08 08:34:06 dist-test-slave-zkpd krb5kdc[15738](info): commencing operation
krb5kdc: starting...
W20260808 08:34:07.585516 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:07 dist-test-slave-zkpd krb5kdc[15738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:07.707055 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36563
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36563
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:07.817842 15751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:07.818111 15751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:07.818190 15751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:07.822079 15751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:07.822161 15751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:07.822201 15751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:07.822256 15751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:07.822296 15751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:07.827349 15751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:07.828344 15751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:07.829315 15751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:07.837515 15756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:07.837615 15757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:07.837668 15751 server_base.cc:1034] running on GCE node
W20260808 08:34:07.837531 15759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:07.838351 15751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:07.839287 15751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:07.840452 15751 hybrid_clock.cc:648] HybridClock initialized: now 1786178047840434 us; error 29 us; skew 500 ppm
Aug 08 08:34:07 dist-test-slave-zkpd krb5kdc[15738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178047, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:07.843027 15751 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:07.843940 15751 webserver.cc:460] Webserver started at http://127.0.0.1:45457/ using document root <none> and password file <none>
I20260808 08:34:07.844470 15751 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:07.844530 15751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:07.844776 15751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:07.846707 15751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "10e408287a7544ae91df9d718d30a8c6"
format_stamp: "Formatted at 2026-08-08 08:34:07 on dist-test-slave-zkpd"
server_key: "1c44e98068409f3d05104d73adc8db1b"
server_key_iv: "92c19ba96a4ce20db3308bb962a3d63d"
server_key_version: "encryptionkey@0"
I20260808 08:34:07.847272 15751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "10e408287a7544ae91df9d718d30a8c6"
format_stamp: "Formatted at 2026-08-08 08:34:07 on dist-test-slave-zkpd"
server_key: "1c44e98068409f3d05104d73adc8db1b"
server_key_iv: "92c19ba96a4ce20db3308bb962a3d63d"
server_key_version: "encryptionkey@0"
I20260808 08:34:07.850888 15751 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:34:07.853176 15767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:07.854348 15751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:34:07.854475 15751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "10e408287a7544ae91df9d718d30a8c6"
format_stamp: "Formatted at 2026-08-08 08:34:07 on dist-test-slave-zkpd"
server_key: "1c44e98068409f3d05104d73adc8db1b"
server_key_iv: "92c19ba96a4ce20db3308bb962a3d63d"
server_key_version: "encryptionkey@0"
I20260808 08:34:07.854573 15751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:07.889225 15751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:07.892091 15751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:07.892297 15751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:07.899767 15751 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36563
I20260808 08:34:07.899794 15821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36563 every 8 connection(s)
I20260808 08:34:07.900719 15751 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:07.903059 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 15751
I20260808 08:34:07.903221 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:07.903545 15822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:07.903548 26280 external_mini_cluster.cc:1428] Setting key 366ec3aa426ab5172f3a675987e2f131
I20260808 08:34:07.909835 15822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6: Bootstrap starting.
I20260808 08:34:07.912197 15822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6: Neither blocks nor log segments found. Creating new log.
Aug 08 08:34:07 dist-test-slave-zkpd krb5kdc[15738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:34:07.912966 15822 log.cc:824] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:07.914983 15822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6: No bootstrap required, opened a new log
I20260808 08:34:07.917757 15825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.905002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:49843 (local address 127.0.0.1:36563)
0808 08:34:07.905435 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.905449 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.905491 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:34:07.906283 (+ 792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.906301 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.906634 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.906978 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.907830 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:07.908878 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:07.909757 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:07.910285 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:07.910457 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:07.913159 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.913163 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.913176 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:07.913203 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.914886 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:07.915456 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:07.915461 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:07.915465 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:07.915570 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:07.915957 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:07.915960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:07.915961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:07.916317 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.916551 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.916875 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.917084 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":137,"threads_started":1}
I20260808 08:34:07.918803 15822 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e408287a7544ae91df9d718d30a8c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } }
I20260808 08:34:07.919067 15822 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:07.919164 15822 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10e408287a7544ae91df9d718d30a8c6, State: Initialized, Role: FOLLOWER
I20260808 08:34:07.919618 15822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e408287a7544ae91df9d718d30a8c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } }
I20260808 08:34:07.919772 15822 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:07.919870 15822 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:07.920025 15822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:07.921041 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:07.921060 15822 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e408287a7544ae91df9d718d30a8c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } }
I20260808 08:34:07.921386 15822 leader_election.cc:302] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10e408287a7544ae91df9d718d30a8c6; no voters:
I20260808 08:34:07.921731 15822 leader_election.cc:288] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:07.921850 15827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:07.922093 15827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [term 1 LEADER]: Becoming Leader. State: Replica: 10e408287a7544ae91df9d718d30a8c6, State: Running, Role: LEADER
I20260808 08:34:07.922467 15827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e408287a7544ae91df9d718d30a8c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } }
I20260808 08:34:07.923060 15822 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:07.923605 15827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10e408287a7544ae91df9d718d30a8c6. Latest consensus state: current_term: 1 leader_uuid: "10e408287a7544ae91df9d718d30a8c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e408287a7544ae91df9d718d30a8c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } } }
I20260808 08:34:07.923799 15827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:07.924052 15828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10e408287a7544ae91df9d718d30a8c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e408287a7544ae91df9d718d30a8c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36563 } } }
I20260808 08:34:07.924188 15828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6 [sys.catalog]: This master's current role is: LEADER
W20260808 08:34:07.929423 15850 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:07.929531 15850 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:07.929615 15842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:07.930549 15842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:07.932220 15825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.923307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:50463 (local address 127.0.0.1:36563)
0808 08:34:07.923458 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.923463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.923980 (+ 517us) server_negotiation.cc:407] Connection header received
0808 08:34:07.924190 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.924194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.924241 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.924303 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.925302 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:07.925997 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:07.926838 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:07.927052 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:07.927133 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:07.928710 (+ 1577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.928714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.928717 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:07.928742 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.930346 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:07.930891 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:07.930897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:07.930903 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:07.930976 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:07.931315 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:07.931321 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:07.931326 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:07.931483 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.931639 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.931944 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.932040 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:34:07.935653 15842 catalog_manager.cc:1347] Generated new cluster ID: 85fcc9f15dbb4cb6a17b2239238bb495
I20260808 08:34:07.935765 15842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:07.947228 15842 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:07.949007 15842 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:07.962877 15842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10e408287a7544ae91df9d718d30a8c6: Generated new TSK 0
I20260808 08:34:07.963518 15842 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:07.970161 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 15751
W20260808 08:34:07.977686 15735 connection.cc:535] client connection to 127.0.0.1:36563 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36563): Connection reset by peer (error 104)
2026-08-08T08:34:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1441 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:08 dist-test-slave-zkpd krb5kdc[15856](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:08 dist-test-slave-zkpd krb5kdc[15856](info): set up 2 sockets
Aug 08 08:34:08 dist-test-slave-zkpd krb5kdc[15856](info): commencing operation
krb5kdc: starting...
W20260808 08:34:09.030161 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:09 dist-test-slave-zkpd krb5kdc[15856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:09.155035 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41393
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:09.267678 15869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:09.268052 15869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:09.268149 15869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:09.272200 15869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:09.272289 15869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:09.272329 15869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:09.272365 15869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:09.272401 15869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:09.277776 15869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:09.279165 15869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:09.280392 15869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:09.289166 15875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:09.289163 15876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:09.289166 15878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:09.289534 15869 server_base.cc:1034] running on GCE node
I20260808 08:34:09.290130 15869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:09.291290 15869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:09.292480 15869 hybrid_clock.cc:648] HybridClock initialized: now 1786178049292465 us; error 26 us; skew 500 ppm
Aug 08 08:34:09 dist-test-slave-zkpd krb5kdc[15856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178049, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:09.299260 15869 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:09.300233 15869 webserver.cc:460] Webserver started at http://127.0.0.1:44611/ using document root <none> and password file <none>
I20260808 08:34:09.300766 15869 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:09.300824 15869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:09.300987 15869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:09.303068 15869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "5c8a624cc1f5471dbcc3c3789bf530a9"
format_stamp: "Formatted at 2026-08-08 08:34:09 on dist-test-slave-zkpd"
server_key: "336c69243a6eb1d6c87ac3445876c65f"
server_key_iv: "83e40a1719630f525ea5315afe5a6c1a"
server_key_version: "encryptionkey@0"
I20260808 08:34:09.303601 15869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "5c8a624cc1f5471dbcc3c3789bf530a9"
format_stamp: "Formatted at 2026-08-08 08:34:09 on dist-test-slave-zkpd"
server_key: "336c69243a6eb1d6c87ac3445876c65f"
server_key_iv: "83e40a1719630f525ea5315afe5a6c1a"
server_key_version: "encryptionkey@0"
I20260808 08:34:09.307176 15869 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:34:09.309540 15886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:09.310732 15869 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:34:09.310886 15869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "5c8a624cc1f5471dbcc3c3789bf530a9"
format_stamp: "Formatted at 2026-08-08 08:34:09 on dist-test-slave-zkpd"
server_key: "336c69243a6eb1d6c87ac3445876c65f"
server_key_iv: "83e40a1719630f525ea5315afe5a6c1a"
server_key_version: "encryptionkey@0"
I20260808 08:34:09.310992 15869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:09.323098 15869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:09.326056 15869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:09.326205 15869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:09.333297 15869 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41393
I20260808 08:34:09.333319 15941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41393 every 8 connection(s)
I20260808 08:34:09.334226 15869 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:09.336891 15942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:09.341476 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 15869
I20260808 08:34:09.341610 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:09.341883 26280 external_mini_cluster.cc:1428] Setting key 1946430e10449bfce250e96e725cec75
I20260808 08:34:09.342353 15942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9: Bootstrap starting.
I20260808 08:34:09.344789 15942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:09.345510 15942 log.cc:824] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:09.347348 15942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9: No bootstrap required, opened a new log
I20260808 08:34:09.350968 15945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:09.343214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:47929 (local address 127.0.0.1:41393)
0808 08:34:09.343740 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:09.343755 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:09.343791 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:34:09.344500 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:09.344516 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:09.344853 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:09.345221 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:09.345671 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:09.346644 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:09.347611 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:09.348171 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:09.348344 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:09.349289 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:09.349294 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:09.349311 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:09.349688 (+ 377us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:09.349746 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:09.349769 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:09.349925 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:09.350109 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 08:34:09.350249 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":126,"threads_started":1}
I20260808 08:34:09.351251 15942 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8a624cc1f5471dbcc3c3789bf530a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } }
I20260808 08:34:09.351523 15942 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:09.351593 15942 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8a624cc1f5471dbcc3c3789bf530a9, State: Initialized, Role: FOLLOWER
I20260808 08:34:09.352061 15942 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8a624cc1f5471dbcc3c3789bf530a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } }
I20260808 08:34:09.352200 15942 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:09.352286 15942 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:09.352415 15942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:09.353528 15942 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8a624cc1f5471dbcc3c3789bf530a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } }
I20260808 08:34:09.353899 15942 leader_election.cc:302] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c8a624cc1f5471dbcc3c3789bf530a9; no voters:
I20260808 08:34:09.354180 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:09.354243 15942 leader_election.cc:288] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:09.354355 15947 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:09.354575 15947 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [term 1 LEADER]: Becoming Leader. State: Replica: 5c8a624cc1f5471dbcc3c3789bf530a9, State: Running, Role: LEADER
I20260808 08:34:09.354984 15947 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8a624cc1f5471dbcc3c3789bf530a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } }
I20260808 08:34:09.355532 15942 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:09.356752 15948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c8a624cc1f5471dbcc3c3789bf530a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8a624cc1f5471dbcc3c3789bf530a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } } }
I20260808 08:34:09.356913 15948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:09.357165 15948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c8a624cc1f5471dbcc3c3789bf530a9. Latest consensus state: current_term: 1 leader_uuid: "5c8a624cc1f5471dbcc3c3789bf530a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c8a624cc1f5471dbcc3c3789bf530a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } } }
I20260808 08:34:09.357259 15948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9 [sys.catalog]: This master's current role is: LEADER
W20260808 08:34:09.360543 15968 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:09.360632 15968 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:09.360958 15962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:09.361649 15962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:09.361976 15945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:09.356641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:38117 (local address 127.0.0.1:41393)
0808 08:34:09.356766 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:09.356772 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:09.357472 (+ 700us) server_negotiation.cc:407] Connection header received
0808 08:34:09.357678 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:09.357683 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:09.357741 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:09.357829 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:09.358269 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:09.358803 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:09.359927 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:09.360252 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:09.360342 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:09.361437 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:09.361441 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:09.361446 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:09.361459 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:09.361486 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:09.361499 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:09.361561 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:09.361810 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 08:34:09.361849 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:34:09.367076 15962 catalog_manager.cc:1347] Generated new cluster ID: e0e3dbfb84124691bc83a7f8d1953bd9
I20260808 08:34:09.367156 15962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:09.390429 15962 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:09.391659 15962 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:09.395237 15962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c8a624cc1f5471dbcc3c3789bf530a9: Generated new TSK 0
I20260808 08:34:09.395926 15962 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:09.400857 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 15869
W20260808 08:34:09.409399 15854 connection.cc:535] client connection to 127.0.0.1:41393 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41393): Connection reset by peer (error 104)
2026-08-08T08:34:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:09 dist-test-slave-zkpd krb5kdc[15975](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:09 dist-test-slave-zkpd krb5kdc[15975](info): set up 2 sockets
Aug 08 08:34:09 dist-test-slave-zkpd krb5kdc[15975](info): commencing operation
krb5kdc: starting...
W20260808 08:34:10.453526 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:10 dist-test-slave-zkpd krb5kdc[15975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:10.579172 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36913
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:10.715356 15991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:10.715656 15991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:10.715740 15991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:10.719749 15991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:10.719843 15991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:10.719885 15991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:10.719964 15991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:10.720014 15991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:10.725438 15991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:10.726509 15991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:10.727550 15991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:10.736146 16000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:10.736150 15996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:10.736150 15998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:10.736229 15991 server_base.cc:1034] running on GCE node
I20260808 08:34:10.736994 15991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:10.738086 15991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:10.739282 15991 hybrid_clock.cc:648] HybridClock initialized: now 1786178050739273 us; error 30 us; skew 500 ppm
Aug 08 08:34:10 dist-test-slave-zkpd krb5kdc[15975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178050, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:10.742156 15991 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:10.743076 15991 webserver.cc:460] Webserver started at http://127.0.0.1:36511/ using document root <none> and password file <none>
I20260808 08:34:10.743643 15991 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:10.743737 15991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:10.744033 15991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:10.746057 15991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "1afe73bcc9c441f58c084f320fdfa726"
format_stamp: "Formatted at 2026-08-08 08:34:10 on dist-test-slave-zkpd"
server_key: "8b1aa3cdada7f40cce739b8a3e0d91c0"
server_key_iv: "49ac12860f7e69682a0c7b8702de10c5"
server_key_version: "encryptionkey@0"
I20260808 08:34:10.746739 15991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "1afe73bcc9c441f58c084f320fdfa726"
format_stamp: "Formatted at 2026-08-08 08:34:10 on dist-test-slave-zkpd"
server_key: "8b1aa3cdada7f40cce739b8a3e0d91c0"
server_key_iv: "49ac12860f7e69682a0c7b8702de10c5"
server_key_version: "encryptionkey@0"
I20260808 08:34:10.750445 15991 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 08:34:10.752782 16007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:10.754006 15991 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:34:10.754149 15991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "1afe73bcc9c441f58c084f320fdfa726"
format_stamp: "Formatted at 2026-08-08 08:34:10 on dist-test-slave-zkpd"
server_key: "8b1aa3cdada7f40cce739b8a3e0d91c0"
server_key_iv: "49ac12860f7e69682a0c7b8702de10c5"
server_key_version: "encryptionkey@0"
I20260808 08:34:10.754261 15991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:10.758770 15991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:10.762144 15991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:10.762358 15991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:10.769748 15991 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36913
I20260808 08:34:10.769788 16064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36913 every 8 connection(s)
I20260808 08:34:10.770706 15991 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:10.773417 16065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:10.775878 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 15991
I20260808 08:34:10.776074 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:10.776369 26280 external_mini_cluster.cc:1428] Setting key a13089e7878dde26e459b1a01427bbea
I20260808 08:34:10.779409 16065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726: Bootstrap starting.
I20260808 08:34:10.781502 16068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:10.777755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:56923 (local address 127.0.0.1:36913)
0808 08:34:10.778214 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:10.778229 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:10.778273 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:34:10.778891 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:10.778908 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:10.779183 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:10.779528 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:10.780334 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:10.780339 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:10.780357 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:10.780372 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:10.780423 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:10.780443 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:10.780594 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:10.780664 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 08:34:10.780821 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":141,"threads_started":1}
I20260808 08:34:10.781941 16065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:10.782795 16065 log.cc:824] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:10.784502 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:10.784988 16065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726: No bootstrap required, opened a new log
I20260808 08:34:10.788424 16068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:10.786784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:46413 (local address 127.0.0.1:36913)
0808 08:34:10.786893 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:10.786900 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:10.787048 (+ 148us) server_negotiation.cc:407] Connection header received
0808 08:34:10.787162 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:10.787164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:10.787191 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:10.787254 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:10.787977 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:10.787980 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:10.787982 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:10.787993 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:10.788017 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:10.788026 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:10.788095 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:10.788218 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 08:34:10.788252 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 08:34:10.789885 16065 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afe73bcc9c441f58c084f320fdfa726" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36913 } }
I20260808 08:34:10.790190 16065 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:10.790266 16065 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1afe73bcc9c441f58c084f320fdfa726, State: Initialized, Role: FOLLOWER
I20260808 08:34:10.790764 16065 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afe73bcc9c441f58c084f320fdfa726" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36913 } }
I20260808 08:34:10.790936 16065 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:10.791009 16065 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:10.791102 16065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:10.792313 16065 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afe73bcc9c441f58c084f320fdfa726" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36913 } }
I20260808 08:34:10.792610 16065 leader_election.cc:302] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1afe73bcc9c441f58c084f320fdfa726; no voters:
I20260808 08:34:10.792896 16065 leader_election.cc:288] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:10.792964 16076 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:10.793161 16076 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [term 1 LEADER]: Becoming Leader. State: Replica: 1afe73bcc9c441f58c084f320fdfa726, State: Running, Role: LEADER
I20260808 08:34:10.793483 16076 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afe73bcc9c441f58c084f320fdfa726" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36913 } }
I20260808 08:34:10.794195 16065 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:10.795151 16078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1afe73bcc9c441f58c084f320fdfa726" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afe73bcc9c441f58c084f320fdfa726" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36913 } } }
I20260808 08:34:10.795280 16078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:10.795670 16077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1afe73bcc9c441f58c084f320fdfa726. Latest consensus state: current_term: 1 leader_uuid: "1afe73bcc9c441f58c084f320fdfa726" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1afe73bcc9c441f58c084f320fdfa726" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36913 } } }
I20260808 08:34:10.795719 16086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:10.795804 16077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:10.799074 16086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:10.805028 16086 catalog_manager.cc:1347] Generated new cluster ID: 03476da4412c4dc98228d86e987bb54c
I20260808 08:34:10.805106 16086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:10.818652 16086 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:10.818976 16086 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:10.826283 16086 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1afe73bcc9c441f58c084f320fdfa726: Generated new TSK 0
I20260808 08:34:10.826910 16086 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:10.832352 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 15991
2026-08-08T08:34:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:10 dist-test-slave-zkpd krb5kdc[16099](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:10 dist-test-slave-zkpd krb5kdc[16099](info): set up 2 sockets
Aug 08 08:34:10 dist-test-slave-zkpd krb5kdc[16099](info): commencing operation
krb5kdc: starting...
W20260808 08:34:11.889530 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:11 dist-test-slave-zkpd krb5kdc[16099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:12.010751 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36375
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36375
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:12.120901 16113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:12.121117 16113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:12.121181 16113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:12.125062 16113 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:12.125110 16113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:12.125159 16113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:12.125195 16113 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:12.125231 16113 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:12.130331 16113 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36375
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:12.131263 16113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:12.132236 16113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:12.140273 16120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:12.140372 16113 server_base.cc:1034] running on GCE node
W20260808 08:34:12.140273 16118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:12.140264 16124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:12.140965 16113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:12.141987 16113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:12.143174 16113 hybrid_clock.cc:648] HybridClock initialized: now 1786178052143155 us; error 29 us; skew 500 ppm
Aug 08 08:34:12 dist-test-slave-zkpd krb5kdc[16099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178052, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:12.145898 16113 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:12.146726 16113 webserver.cc:460] Webserver started at http://127.0.0.1:37807/ using document root <none> and password file <none>
I20260808 08:34:12.147258 16113 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:12.147357 16113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:12.147583 16113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:12.149596 16113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "b3c5bf4891894047b456d1a02d6a89be"
format_stamp: "Formatted at 2026-08-08 08:34:12 on dist-test-slave-zkpd"
server_key: "39ac768b4ad55cfe806dbad29dd1d92b"
server_key_iv: "d2ea721c3368ad38fc2dd50a894c0243"
server_key_version: "encryptionkey@0"
I20260808 08:34:12.150151 16113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "b3c5bf4891894047b456d1a02d6a89be"
format_stamp: "Formatted at 2026-08-08 08:34:12 on dist-test-slave-zkpd"
server_key: "39ac768b4ad55cfe806dbad29dd1d92b"
server_key_iv: "d2ea721c3368ad38fc2dd50a894c0243"
server_key_version: "encryptionkey@0"
I20260808 08:34:12.153760 16113 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:34:12.156019 16131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:12.157220 16113 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:34:12.157383 16113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "b3c5bf4891894047b456d1a02d6a89be"
format_stamp: "Formatted at 2026-08-08 08:34:12 on dist-test-slave-zkpd"
server_key: "39ac768b4ad55cfe806dbad29dd1d92b"
server_key_iv: "d2ea721c3368ad38fc2dd50a894c0243"
server_key_version: "encryptionkey@0"
I20260808 08:34:12.157493 16113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:12.177528 16113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:12.180855 16113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:12.181070 16113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:12.188135 16113 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36375
I20260808 08:34:12.188162 16187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36375 every 8 connection(s)
I20260808 08:34:12.189122 16113 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:12.191819 16188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:12.196903 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 16113
I20260808 08:34:12.197045 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:12.197319 26280 external_mini_cluster.cc:1428] Setting key 13865ca160ff76d4aa4790f8b7fbf301
I20260808 08:34:12.197465 16188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be: Bootstrap starting.
I20260808 08:34:12.200239 16188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:12.201138 16188 log.cc:824] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:12.203167 16188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be: No bootstrap required, opened a new log
Aug 08 08:34:12 dist-test-slave-zkpd krb5kdc[16099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:34:12.207795 16188 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5bf4891894047b456d1a02d6a89be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } }
I20260808 08:34:12.208083 16188 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:12.208182 16188 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3c5bf4891894047b456d1a02d6a89be, State: Initialized, Role: FOLLOWER
I20260808 08:34:12.208715 16188 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5bf4891894047b456d1a02d6a89be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } }
I20260808 08:34:12.208899 16188 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:12.208969 16188 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:12.209077 16188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:12.210211 16188 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5bf4891894047b456d1a02d6a89be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } }
I20260808 08:34:12.210587 16188 leader_election.cc:302] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3c5bf4891894047b456d1a02d6a89be; no voters:
I20260808 08:34:12.210958 16188 leader_election.cc:288] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:12.211041 16193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:12.211249 16193 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [term 1 LEADER]: Becoming Leader. State: Replica: b3c5bf4891894047b456d1a02d6a89be, State: Running, Role: LEADER
I20260808 08:34:12.211568 16193 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5bf4891894047b456d1a02d6a89be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } }
I20260808 08:34:12.212387 16188 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:12.213117 16194 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3c5bf4891894047b456d1a02d6a89be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5bf4891894047b456d1a02d6a89be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } } }
I20260808 08:34:12.213234 16194 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:12.213622 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:12.198752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:47497 (local address 127.0.0.1:36375)
0808 08:34:12.199162 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:12.199180 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:12.199224 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:34:12.200089 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:12.200117 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:12.200581 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:12.200949 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:12.201715 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:12.202766 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:12.203966 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:12.204418 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:12.204548 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:12.207474 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:12.207481 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:12.207497 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:12.207531 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:12.209688 (+ 2157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:12.210211 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:12.210218 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:12.210225 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:12.210370 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:12.210691 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:12.210697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:12.210700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:12.211225 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:12.212183 (+ 958us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:12.212358 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 08:34:12.212585 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":107,"threads_started":1}
I20260808 08:34:12.213634 16195 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3c5bf4891894047b456d1a02d6a89be. Latest consensus state: current_term: 1 leader_uuid: "b3c5bf4891894047b456d1a02d6a89be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5bf4891894047b456d1a02d6a89be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36375 } } }
I20260808 08:34:12.214516 16195 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:12.214815 16202 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:12.216931 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:12.218200 16202 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:12.224754 16202 catalog_manager.cc:1347] Generated new cluster ID: 8e2b21fbc79747f593916ed2de3c9b9a
I20260808 08:34:12.224813 16202 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:12.227715 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:12.219143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:39451 (local address 127.0.0.1:36375)
0808 08:34:12.219250 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:12.219255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:12.219455 (+ 200us) server_negotiation.cc:407] Connection header received
0808 08:34:12.219566 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:12.219569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:12.219621 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:12.219709 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:12.220505 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:12.221026 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:12.221849 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:12.222109 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:12.222227 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:12.224040 (+ 1813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:12.224044 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:12.224047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:12.224072 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:12.225670 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:12.226209 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:12.226213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:12.226215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:12.226301 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:12.226643 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:12.226646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:12.226648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:12.226860 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:12.227029 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:12.227280 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 08:34:12.227561 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 08:34:12.234326 16202 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:12.235438 16202 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:12.252830 16202 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3c5bf4891894047b456d1a02d6a89be: Generated new TSK 0
I20260808 08:34:12.253489 16202 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:12.265475 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 16113
W20260808 08:34:12.274087 16097 connection.cc:535] client connection to 127.0.0.1:36375 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36375): Connection reset by peer (error 104)
2026-08-08T08:34:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:12 dist-test-slave-zkpd krb5kdc[16222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:12 dist-test-slave-zkpd krb5kdc[16222](info): set up 2 sockets
Aug 08 08:34:12 dist-test-slave-zkpd krb5kdc[16222](info): commencing operation
krb5kdc: starting...
W20260808 08:34:13.330004 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:13 dist-test-slave-zkpd krb5kdc[16222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:13.458376 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37671
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:13.573320 16235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:13.573603 16235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:13.573686 16235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:13.578637 16235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:13.578739 16235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:13.578780 16235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:13.578804 16235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:13.578836 16235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:13.584307 16235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37671
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:13.585250 16235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:13.586254 16235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:13.594722 16243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:13.594722 16240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:13.594751 16241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:13.595048 16235 server_base.cc:1034] running on GCE node
I20260808 08:34:13.595602 16235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:13.596760 16235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:13.597918 16235 hybrid_clock.cc:648] HybridClock initialized: now 1786178053597889 us; error 41 us; skew 500 ppm
Aug 08 08:34:13 dist-test-slave-zkpd krb5kdc[16222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178053, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:13.600739 16235 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:13.601617 16235 webserver.cc:460] Webserver started at http://127.0.0.1:42701/ using document root <none> and password file <none>
I20260808 08:34:13.602201 16235 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:13.602263 16235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:13.602487 16235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:13.604527 16235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "d24339b6e0ca4e9dae3617cb562674e5"
format_stamp: "Formatted at 2026-08-08 08:34:13 on dist-test-slave-zkpd"
server_key: "f5f6c903cd93a1b607f92b38efb16255"
server_key_iv: "a9136d49bd1cd3ae12fd66845eff18e6"
server_key_version: "encryptionkey@0"
I20260808 08:34:13.605075 16235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "d24339b6e0ca4e9dae3617cb562674e5"
format_stamp: "Formatted at 2026-08-08 08:34:13 on dist-test-slave-zkpd"
server_key: "f5f6c903cd93a1b607f92b38efb16255"
server_key_iv: "a9136d49bd1cd3ae12fd66845eff18e6"
server_key_version: "encryptionkey@0"
I20260808 08:34:13.608682 16235 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:34:13.611028 16250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:13.612273 16235 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:34:13.612419 16235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "d24339b6e0ca4e9dae3617cb562674e5"
format_stamp: "Formatted at 2026-08-08 08:34:13 on dist-test-slave-zkpd"
server_key: "f5f6c903cd93a1b607f92b38efb16255"
server_key_iv: "a9136d49bd1cd3ae12fd66845eff18e6"
server_key_version: "encryptionkey@0"
I20260808 08:34:13.612524 16235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:13.650779 16235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:13.653716 16235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:13.653960 16235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:13.661176 16235 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37671
I20260808 08:34:13.661203 16309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37671 every 8 connection(s)
I20260808 08:34:13.662122 16235 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:13.664788 16310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:13.667585 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 16235
I20260808 08:34:13.667748 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:13.668076 26280 external_mini_cluster.cc:1428] Setting key dfdce329e7b98b9c2dd30112c59b487f
I20260808 08:34:13.670809 16310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5: Bootstrap starting.
I20260808 08:34:13.672948 16310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:13.673681 16310 log.cc:824] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:13.675592 16310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5: No bootstrap required, opened a new log
I20260808 08:34:13.677002 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:13.669514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:56109 (local address 127.0.0.1:37671)
0808 08:34:13.669974 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:13.669988 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:13.670022 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:34:13.670614 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:13.670631 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:13.671027 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:13.671352 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:13.671756 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:13.672754 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:13.673726 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:13.674243 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:13.674418 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:13.675297 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:13.675302 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:13.675315 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:13.675678 (+ 363us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:13.675779 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:13.675804 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:13.675991 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:13.676168 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 08:34:13.676307 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":155,"threads_started":1}
I20260808 08:34:13.679709 16310 raft_consensus.cc:348] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d24339b6e0ca4e9dae3617cb562674e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37671 } }
I20260808 08:34:13.680025 16310 raft_consensus.cc:374] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:13.680083 16310 raft_consensus.cc:729] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24339b6e0ca4e9dae3617cb562674e5, State: Initialized, Role: FOLLOWER
I20260808 08:34:13.680106 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:13.680514 16310 consensus_queue.cc:260] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d24339b6e0ca4e9dae3617cb562674e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37671 } }
I20260808 08:34:13.680672 16310 raft_consensus.cc:388] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:13.680730 16310 raft_consensus.cc:482] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:13.680825 16310 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:13.681934 16310 raft_consensus.cc:504] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d24339b6e0ca4e9dae3617cb562674e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37671 } }
I20260808 08:34:13.682354 16310 leader_election.cc:302] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d24339b6e0ca4e9dae3617cb562674e5; no voters:
I20260808 08:34:13.682691 16310 leader_election.cc:288] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:13.682755 16320 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:13.682948 16320 raft_consensus.cc:686] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [term 1 LEADER]: Becoming Leader. State: Replica: d24339b6e0ca4e9dae3617cb562674e5, State: Running, Role: LEADER
I20260808 08:34:13.683243 16320 consensus_queue.cc:237] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d24339b6e0ca4e9dae3617cb562674e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37671 } }
I20260808 08:34:13.683934 16310 sys_catalog.cc:564] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:13.684427 16323 sys_catalog.cc:455] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d24339b6e0ca4e9dae3617cb562674e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d24339b6e0ca4e9dae3617cb562674e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37671 } } }
I20260808 08:34:13.684615 16323 sys_catalog.cc:458] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:13.684885 16321 sys_catalog.cc:455] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d24339b6e0ca4e9dae3617cb562674e5. Latest consensus state: current_term: 1 leader_uuid: "d24339b6e0ca4e9dae3617cb562674e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d24339b6e0ca4e9dae3617cb562674e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37671 } } }
I20260808 08:34:13.685004 16321 sys_catalog.cc:458] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:13.685675 16329 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:13.687467 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:13.682452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:53337 (local address 127.0.0.1:37671)
0808 08:34:13.682637 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:13.682640 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:13.682869 (+ 229us) server_negotiation.cc:407] Connection header received
0808 08:34:13.683072 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:13.683075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:13.683120 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:13.683166 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:13.683613 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:13.684385 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:13.685486 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:13.685797 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:13.685897 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:13.686906 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:13.686909 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:13.686912 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:13.686925 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:13.686951 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:13.686963 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:13.687054 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:13.687262 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 08:34:13.687315 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":102}
I20260808 08:34:13.689244 16329 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:13.694718 16329 catalog_manager.cc:1347] Generated new cluster ID: 95d88ff3037b49418f08629d8021f19b
I20260808 08:34:13.694813 16329 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:13.715551 16329 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:13.716522 16329 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:13.726506 16329 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d24339b6e0ca4e9dae3617cb562674e5: Generated new TSK 0
I20260808 08:34:13.727316 16329 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:13.734218 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 16235
W20260808 08:34:13.742298 16220 connection.cc:535] client connection to 127.0.0.1:37671 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37671): Connection reset by peer (error 104)
2026-08-08T08:34:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1467 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:13 dist-test-slave-zkpd krb5kdc[16344](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:13 dist-test-slave-zkpd krb5kdc[16344](info): set up 2 sockets
Aug 08 08:34:13 dist-test-slave-zkpd krb5kdc[16344](info): commencing operation
krb5kdc: starting...
W20260808 08:34:14.797577 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:14 dist-test-slave-zkpd krb5kdc[16344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:34:14.919332 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46691
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46691
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:15.030620 16359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:15.030862 16359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:15.030902 16359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:15.034726 16359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:15.034775 16359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:15.034798 16359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:15.034816 16359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:15.034830 16359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:15.039786 16359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46691
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:15.040731 16359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:15.041656 16359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:15.049705 16364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:15.049769 16359 server_base.cc:1034] running on GCE node
W20260808 08:34:15.049731 16365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:15.049729 16367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:15.050588 16359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:15.051610 16359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:15.052806 16359 hybrid_clock.cc:648] HybridClock initialized: now 1786178055052772 us; error 44 us; skew 500 ppm
Aug 08 08:34:15 dist-test-slave-zkpd krb5kdc[16344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:15.059330 16359 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:34:15.060276 16359 webserver.cc:460] Webserver started at http://127.0.0.1:42017/ using document root <none> and password file <none>
I20260808 08:34:15.060817 16359 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:15.060907 16359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:15.061146 16359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:15.063086 16359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "6cff730e29b3473198e9db702d73e1d6"
format_stamp: "Formatted at 2026-08-08 08:34:15 on dist-test-slave-zkpd"
server_key: "3ed8851fbc1704b3718e7c8acd96b217"
server_key_iv: "121f30e89bf50eecf3486bea08650d93"
server_key_version: "encryptionkey@0"
I20260808 08:34:15.063655 16359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "6cff730e29b3473198e9db702d73e1d6"
format_stamp: "Formatted at 2026-08-08 08:34:15 on dist-test-slave-zkpd"
server_key: "3ed8851fbc1704b3718e7c8acd96b217"
server_key_iv: "121f30e89bf50eecf3486bea08650d93"
server_key_version: "encryptionkey@0"
I20260808 08:34:15.067334 16359 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:34:15.069703 16374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:15.070848 16359 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:34:15.070987 16359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "6cff730e29b3473198e9db702d73e1d6"
format_stamp: "Formatted at 2026-08-08 08:34:15 on dist-test-slave-zkpd"
server_key: "3ed8851fbc1704b3718e7c8acd96b217"
server_key_iv: "121f30e89bf50eecf3486bea08650d93"
server_key_version: "encryptionkey@0"
I20260808 08:34:15.071094 16359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:15.075519 16359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:15.078284 16359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:15.078490 16359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:15.085721 16359 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46691
I20260808 08:34:15.085752 16430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46691 every 8 connection(s)
I20260808 08:34:15.086571 16359 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:15.089197 16431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:15.094545 16431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6: Bootstrap starting.
I20260808 08:34:15.095116 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 16359
I20260808 08:34:15.095270 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:15.095561 26280 external_mini_cluster.cc:1428] Setting key 14f2af35963d2e995ba456a0e7bc983d
I20260808 08:34:15.097429 16431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:15.098130 16431 log.cc:824] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:15.100338 16431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6: No bootstrap required, opened a new log
I20260808 08:34:15.100968 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:15.096917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:35181 (local address 127.0.0.1:46691)
0808 08:34:15.097339 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.097353 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.097387 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:34:15.098045 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.098062 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.098382 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.098738 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:15.099559 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:15.099569 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:15.099580 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:15.099592 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:15.099658 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:15.099679 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:15.099782 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:15.100005 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 08:34:15.100224 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":124,"threads_started":1}
I20260808 08:34:15.103917 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:15.104501 16431 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cff730e29b3473198e9db702d73e1d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46691 } }
I20260808 08:34:15.104776 16431 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:15.104843 16431 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cff730e29b3473198e9db702d73e1d6, State: Initialized, Role: FOLLOWER
I20260808 08:34:15.105330 16431 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cff730e29b3473198e9db702d73e1d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46691 } }
I20260808 08:34:15.105520 16431 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:15.105604 16431 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:15.105693 16431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:15.106678 16431 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cff730e29b3473198e9db702d73e1d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46691 } }
I20260808 08:34:15.107070 16431 leader_election.cc:302] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cff730e29b3473198e9db702d73e1d6; no voters:
I20260808 08:34:15.107455 16431 leader_election.cc:288] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:15.107558 16442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:15.107793 16442 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [term 1 LEADER]: Becoming Leader. State: Replica: 6cff730e29b3473198e9db702d73e1d6, State: Running, Role: LEADER
I20260808 08:34:15.108194 16442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cff730e29b3473198e9db702d73e1d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46691 } }
I20260808 08:34:15.108322 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:15.106271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.39:52343 (local address 127.0.0.1:46691)
0808 08:34:15.106398 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.106404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.106633 (+ 229us) server_negotiation.cc:407] Connection header received
0808 08:34:15.106748 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.106751 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.106782 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.106867 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:15.107656 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:15.107661 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:15.107663 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:15.107677 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:15.107704 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:15.107721 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:15.107828 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:15.108132 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 08:34:15.108171 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:34:15.108724 16431 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:15.109406 16442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cff730e29b3473198e9db702d73e1d6. Latest consensus state: current_term: 1 leader_uuid: "6cff730e29b3473198e9db702d73e1d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cff730e29b3473198e9db702d73e1d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46691 } } }
I20260808 08:34:15.109519 16442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:15.110131 16449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:15.110100 16444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cff730e29b3473198e9db702d73e1d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cff730e29b3473198e9db702d73e1d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46691 } } }
I20260808 08:34:15.110189 16444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:15.113191 16449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:15.118695 16449 catalog_manager.cc:1347] Generated new cluster ID: 57aa8508225e49c1a444b3007fcd7aff
I20260808 08:34:15.118762 16449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:15.128644 16449 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:15.128933 16449 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:15.136296 16449 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cff730e29b3473198e9db702d73e1d6: Generated new TSK 0
I20260808 08:34:15.136906 16449 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:15.143450 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 16359
2026-08-08T08:34:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1410 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:15 dist-test-slave-zkpd krb5kdc[16466](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:15 dist-test-slave-zkpd krb5kdc[16466](info): set up 2 sockets
Aug 08 08:34:15 dist-test-slave-zkpd krb5kdc[16466](info): commencing operation
krb5kdc: starting...
W20260808 08:34:16.210027 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:16 dist-test-slave-zkpd krb5kdc[16466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:34:16.334003 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:46375
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:32871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:46375
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:16.444466 16480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:16.444756 16480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:16.444864 16480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:16.448909 16480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:16.448985 16480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:16.449021 16480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:16.449076 16480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:16.449115 16480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:16.454834 16480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:32871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:46375
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:46375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:16.455967 16480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:16.457023 16480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:16.467932 16487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:16.467938 16486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:16.468057 16489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:16.468827 16480 server_base.cc:1034] running on GCE node
I20260808 08:34:16.469556 16480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:16.471077 16480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:16.472285 16480 hybrid_clock.cc:648] HybridClock initialized: now 1786178056472258 us; error 41 us; skew 500 ppm
Aug 08 08:34:16 dist-test-slave-zkpd krb5kdc[16466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178056, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:16.476152 16480 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:34:16.477388 16480 webserver.cc:460] Webserver started at http://127.25.170.62:33867/ using document root <none> and password file <none>
I20260808 08:34:16.478111 16480 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:16.478193 16480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:16.478477 16480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:16.481022 16480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "fea8275549f3483f890ee4847ca7a3c8"
format_stamp: "Formatted at 2026-08-08 08:34:16 on dist-test-slave-zkpd"
server_key: "b75d7a35115bd8af05ef8b2c62fff696"
server_key_iv: "3ec47d884cac68bac542bbf0a759cfc3"
server_key_version: "encryptionkey@0"
I20260808 08:34:16.481679 16480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "fea8275549f3483f890ee4847ca7a3c8"
format_stamp: "Formatted at 2026-08-08 08:34:16 on dist-test-slave-zkpd"
server_key: "b75d7a35115bd8af05ef8b2c62fff696"
server_key_iv: "3ec47d884cac68bac542bbf0a759cfc3"
server_key_version: "encryptionkey@0"
I20260808 08:34:16.486873 16480 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:34:16.489444 16496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:16.490674 16480 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:34:16.490832 16480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "fea8275549f3483f890ee4847ca7a3c8"
format_stamp: "Formatted at 2026-08-08 08:34:16 on dist-test-slave-zkpd"
server_key: "b75d7a35115bd8af05ef8b2c62fff696"
server_key_iv: "3ec47d884cac68bac542bbf0a759cfc3"
server_key_version: "encryptionkey@0"
I20260808 08:34:16.490949 16480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:16.520110 16480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:16.523376 16480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:16.523579 16480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:16.530499 16480 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:46375
I20260808 08:34:16.530580 16552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:46375 every 8 connection(s)
I20260808 08:34:16.531453 16480 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:16.534236 16553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:16.539570 16553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8: Bootstrap starting.
I20260808 08:34:16.540750 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 16480
I20260808 08:34:16.540915 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:16.541203 26280 external_mini_cluster.cc:1428] Setting key 9d77501f3b71f2852fc5a10648d5dcbc
I20260808 08:34:16.542523 16553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:16.543264 16553 log.cc:824] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:16.545540 16553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8: No bootstrap required, opened a new log
I20260808 08:34:16.549962 16553 raft_consensus.cc:348] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea8275549f3483f890ee4847ca7a3c8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46375 } }
Aug 08 08:34:16 dist-test-slave-zkpd krb5kdc[16466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:34:16.550199 16553 raft_consensus.cc:374] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:16.550289 16553 raft_consensus.cc:729] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea8275549f3483f890ee4847ca7a3c8, State: Initialized, Role: FOLLOWER
I20260808 08:34:16.550765 16553 consensus_queue.cc:260] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea8275549f3483f890ee4847ca7a3c8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46375 } }
I20260808 08:34:16.550925 16553 raft_consensus.cc:388] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:16.550995 16553 raft_consensus.cc:482] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:16.551095 16553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:16.552228 16553 raft_consensus.cc:504] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea8275549f3483f890ee4847ca7a3c8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46375 } }
I20260808 08:34:16.552561 16553 leader_election.cc:302] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fea8275549f3483f890ee4847ca7a3c8; no voters:
I20260808 08:34:16.552910 16553 leader_election.cc:288] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:16.552950 16559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:16.553169 16559 raft_consensus.cc:686] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [term 1 LEADER]: Becoming Leader. State: Replica: fea8275549f3483f890ee4847ca7a3c8, State: Running, Role: LEADER
I20260808 08:34:16.553459 16559 consensus_queue.cc:237] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea8275549f3483f890ee4847ca7a3c8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46375 } }
I20260808 08:34:16.554216 16553 sys_catalog.cc:564] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:16.555408 16560 sys_catalog.cc:455] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fea8275549f3483f890ee4847ca7a3c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea8275549f3483f890ee4847ca7a3c8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46375 } } }
I20260808 08:34:16.555454 16561 sys_catalog.cc:455] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fea8275549f3483f890ee4847ca7a3c8. Latest consensus state: current_term: 1 leader_uuid: "fea8275549f3483f890ee4847ca7a3c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea8275549f3483f890ee4847ca7a3c8" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 46375 } } }
I20260808 08:34:16.555537 16560 sys_catalog.cc:458] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:16.555549 16561 sys_catalog.cc:458] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:16.556031 16564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:16.556550 16556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:16.542308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55053 (local address 127.25.170.62:46375)
0808 08:34:16.542716 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:16.542731 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:16.542766 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:34:16.543409 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:16.543450 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:16.543892 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:16.544258 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:16.545128 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:16.546139 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:16.547344 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:16.547805 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:16.547983 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:16.550870 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:16.550875 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:16.550887 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:16.550937 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:16.552845 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:16.553432 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:16.553437 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:16.553442 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:16.553607 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:16.554016 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:16.554019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:16.554021 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:16.554471 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:16.554702 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:16.555067 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 08:34:16.555324 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":264,"thread_start_us":133,"threads_started":1}
I20260808 08:34:16.559762 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:16.560642 16564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:16.566363 16564 catalog_manager.cc:1347] Generated new cluster ID: 55314fc4e8d9469890d773016ed088cd
I20260808 08:34:16.566419 16564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:16.573362 16556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:16.564445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54153 (local address 127.25.170.62:46375)
0808 08:34:16.564547 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:16.564551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:16.564828 (+ 277us) server_negotiation.cc:407] Connection header received
0808 08:34:16.565010 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:16.565013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:16.565055 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:16.565157 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:16.565832 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:16.566584 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:16.567779 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:16.568182 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:16.568275 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:16.569908 (+ 1633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:16.569911 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:16.569914 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:16.569937 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:16.571536 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:16.572122 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:16.572126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:16.572128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:16.572208 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:16.572554 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:16.572557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:16.572559 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:16.572733 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:16.572861 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:16.573136 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 08:34:16.573221 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":40}
I20260808 08:34:16.582072 16564 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:16.582880 16564 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:16.587659 16564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fea8275549f3483f890ee4847ca7a3c8: Generated new TSK 0
I20260808 08:34:16.588347 16564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:16.594940 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 16480
W20260808 08:34:16.603247 16464 connection.cc:535] client connection to 127.25.170.62:46375 recv error: Network error: failed to read from TLS socket (remote: 127.25.170.62:46375): Connection reset by peer (error 104)
2026-08-08T08:34:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1450 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:16 dist-test-slave-zkpd krb5kdc[16587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:16 dist-test-slave-zkpd krb5kdc[16587](info): set up 2 sockets
Aug 08 08:34:16 dist-test-slave-zkpd krb5kdc[16587](info): commencing operation
krb5kdc: starting...
W20260808 08:34:17.658097 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:17 dist-test-slave-zkpd krb5kdc[16587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:34:17.780529 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39683
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:38437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:39683
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:17.902295 16601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:17.902529 16601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:17.902568 16601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:17.906736 16601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:17.906795 16601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:17.906814 16601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:17.906831 16601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:17.906845 16601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:17.912001 16601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:39683
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:39683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:17.912927 16601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:17.913875 16601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:17.922209 16609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:17.922376 16607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:17.922252 16601 server_base.cc:1034] running on GCE node
W20260808 08:34:17.922209 16606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:17.923040 16601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:17.924167 16601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:17.925362 16601 hybrid_clock.cc:648] HybridClock initialized: now 1786178057925335 us; error 46 us; skew 500 ppm
Aug 08 08:34:17 dist-test-slave-zkpd krb5kdc[16587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178057, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:17.928134 16601 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:34:17.929054 16601 webserver.cc:460] Webserver started at http://127.25.170.62:35067/ using document root <none> and password file <none>
I20260808 08:34:17.929591 16601 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:17.929682 16601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:17.929919 16601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:17.931975 16601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "dad6f186b6214efab79695f2d78118db"
format_stamp: "Formatted at 2026-08-08 08:34:17 on dist-test-slave-zkpd"
server_key: "7fcd7d41e866a4c15dc8934f9c2334f9"
server_key_iv: "7a78a18f838e79c71cd055935df9487d"
server_key_version: "encryptionkey@0"
I20260808 08:34:17.932530 16601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "dad6f186b6214efab79695f2d78118db"
format_stamp: "Formatted at 2026-08-08 08:34:17 on dist-test-slave-zkpd"
server_key: "7fcd7d41e866a4c15dc8934f9c2334f9"
server_key_iv: "7a78a18f838e79c71cd055935df9487d"
server_key_version: "encryptionkey@0"
I20260808 08:34:17.936159 16601 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 08:34:17.938388 16616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:17.939580 16601 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:34:17.939715 16601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "dad6f186b6214efab79695f2d78118db"
format_stamp: "Formatted at 2026-08-08 08:34:17 on dist-test-slave-zkpd"
server_key: "7fcd7d41e866a4c15dc8934f9c2334f9"
server_key_iv: "7a78a18f838e79c71cd055935df9487d"
server_key_version: "encryptionkey@0"
I20260808 08:34:17.939851 16601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:17.957794 16601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:17.960952 16601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:17.961155 16601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:17.968441 16601 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:39683
I20260808 08:34:17.968465 16670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:39683 every 8 connection(s)
I20260808 08:34:17.969343 16601 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:17.972047 16671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:17.976984 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 16601
I20260808 08:34:17.977144 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:17.977413 26280 external_mini_cluster.cc:1428] Setting key 55e7576bc24c8eeb77e2b965b6091ed3
I20260808 08:34:17.977626 16671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db: Bootstrap starting.
I20260808 08:34:17.980129 16671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:17.981027 16671 log.cc:824] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:17.983218 16671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db: No bootstrap required, opened a new log
I20260808 08:34:17.986191 16674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:17.978673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44677 (local address 127.25.170.62:39683)
0808 08:34:17.979080 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:17.979095 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:17.979131 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:34:17.979754 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:17.979770 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:17.980162 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:17.980474 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:17.980804 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:17.981788 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:17.982998 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:17.983498 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:17.983611 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:17.984518 (+ 907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:17.984523 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:17.984535 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:17.984926 (+ 391us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:17.984979 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:17.985002 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:17.985103 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:17.985311 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 08:34:17.985468 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":132,"threads_started":1}
I20260808 08:34:17.987252 16671 raft_consensus.cc:348] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad6f186b6214efab79695f2d78118db" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39683 } }
I20260808 08:34:17.987512 16671 raft_consensus.cc:374] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:17.987578 16671 raft_consensus.cc:729] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dad6f186b6214efab79695f2d78118db, State: Initialized, Role: FOLLOWER
I20260808 08:34:17.988035 16671 consensus_queue.cc:260] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad6f186b6214efab79695f2d78118db" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39683 } }
I20260808 08:34:17.988198 16671 raft_consensus.cc:388] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:17.988283 16671 raft_consensus.cc:482] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:17.988410 16671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:17.989410 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:17.989517 16671 raft_consensus.cc:504] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad6f186b6214efab79695f2d78118db" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39683 } }
I20260808 08:34:17.989887 16671 leader_election.cc:302] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dad6f186b6214efab79695f2d78118db; no voters:
I20260808 08:34:17.990263 16671 leader_election.cc:288] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:17.990327 16676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:17.990523 16676 raft_consensus.cc:686] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [term 1 LEADER]: Becoming Leader. State: Replica: dad6f186b6214efab79695f2d78118db, State: Running, Role: LEADER
I20260808 08:34:17.990882 16676 consensus_queue.cc:237] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad6f186b6214efab79695f2d78118db" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39683 } }
I20260808 08:34:17.991539 16671 sys_catalog.cc:564] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:17.992180 16678 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [sys.catalog]: SysCatalogTable state changed. Reason: New leader dad6f186b6214efab79695f2d78118db. Latest consensus state: current_term: 1 leader_uuid: "dad6f186b6214efab79695f2d78118db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad6f186b6214efab79695f2d78118db" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39683 } } }
I20260808 08:34:17.992324 16678 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:17.993098 16677 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dad6f186b6214efab79695f2d78118db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dad6f186b6214efab79695f2d78118db" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 39683 } } }
I20260808 08:34:17.993196 16677 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:17.994059 16688 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:17.996779 16674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:17.991748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48181 (local address 127.25.170.62:39683)
0808 08:34:17.991867 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:17.991872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:17.992136 (+ 264us) server_negotiation.cc:407] Connection header received
0808 08:34:17.992350 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:17.992353 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:17.992401 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:17.992459 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:17.992947 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:17.993739 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:17.994927 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:17.995142 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:17.995224 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:17.996269 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:17.996273 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:17.996276 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:17.996289 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:17.996318 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:17.996334 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:17.996427 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:17.996602 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 08:34:17.996636 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 08:34:17.997758 16688 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:18.003376 16688 catalog_manager.cc:1347] Generated new cluster ID: 40438d44dcb845ec8c09cb3ead5a850f
I20260808 08:34:18.003449 16688 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:18.019677 16688 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:18.020772 16688 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:18.031248 16688 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dad6f186b6214efab79695f2d78118db: Generated new TSK 0
I20260808 08:34:18.032094 16688 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:18.044812 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 16601
W20260808 08:34:18.052915 16585 connection.cc:535] client connection to 127.25.170.62:39683 recv error: Network error: failed to read from TLS socket (remote: 127.25.170.62:39683): Connection reset by peer (error 104)
2026-08-08T08:34:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:18 dist-test-slave-zkpd krb5kdc[16702](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:18 dist-test-slave-zkpd krb5kdc[16702](info): set up 2 sockets
Aug 08 08:34:18 dist-test-slave-zkpd krb5kdc[16702](info): commencing operation
krb5kdc: starting...
W20260808 08:34:19.105862 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:19 dist-test-slave-zkpd krb5kdc[16702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:34:19.228919 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:35113
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:38217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:35113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:19.342867 16717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:19.343106 16717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:19.343180 16717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:19.347084 16717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:19.347137 16717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:19.347157 16717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:19.347208 16717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:19.347241 16717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:19.352270 16717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:35113
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:35113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:19.353258 16717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:19.354303 16717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:19.362603 16726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:19.362598 16724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:19.362612 16723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:19.362646 16717 server_base.cc:1034] running on GCE node
I20260808 08:34:19.363440 16717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:19.364552 16717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:19.365763 16717 hybrid_clock.cc:648] HybridClock initialized: now 1786178059365734 us; error 39 us; skew 500 ppm
Aug 08 08:34:19 dist-test-slave-zkpd krb5kdc[16702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178059, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:19.368593 16717 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:34:19.369496 16717 webserver.cc:460] Webserver started at http://127.25.170.62:38013/ using document root <none> and password file <none>
I20260808 08:34:19.370034 16717 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:19.370126 16717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:19.370359 16717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:19.372398 16717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "73d1066dbf444ee8b62963f97010ac1c"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-zkpd"
server_key: "c0a3ff373475f568627d8651c9d89955"
server_key_iv: "1ff4e70f22cfe9ad0aa0ca8139cbb540"
server_key_version: "encryptionkey@0"
I20260808 08:34:19.372969 16717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "73d1066dbf444ee8b62963f97010ac1c"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-zkpd"
server_key: "c0a3ff373475f568627d8651c9d89955"
server_key_iv: "1ff4e70f22cfe9ad0aa0ca8139cbb540"
server_key_version: "encryptionkey@0"
I20260808 08:34:19.376598 16717 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:19.379010 16735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:19.380221 16717 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:34:19.380379 16717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "73d1066dbf444ee8b62963f97010ac1c"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-zkpd"
server_key: "c0a3ff373475f568627d8651c9d89955"
server_key_iv: "1ff4e70f22cfe9ad0aa0ca8139cbb540"
server_key_version: "encryptionkey@0"
I20260808 08:34:19.380488 16717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:19.384976 16717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:19.387712 16717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:19.387969 16717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:19.394883 16717 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:35113
I20260808 08:34:19.394896 16790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:35113 every 8 connection(s)
I20260808 08:34:19.395756 16717 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:19.398546 16791 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:19.403934 16791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c: Bootstrap starting.
I20260808 08:34:19.404892 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 16717
I20260808 08:34:19.405046 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:19.405359 26280 external_mini_cluster.cc:1428] Setting key ea89d51d1e5fdf424857ac7be3f2b37f
I20260808 08:34:19.406826 16791 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:19.407752 16791 log.cc:824] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:19.410058 16791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c: No bootstrap required, opened a new log
I20260808 08:34:19.410794 16795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:19.406498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40945 (local address 127.25.170.62:35113)
0808 08:34:19.407007 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:19.407028 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:19.407078 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:34:19.407965 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:19.407989 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:19.408335 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:19.408690 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:19.409403 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:19.409409 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:19.409427 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:19.409439 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:19.409502 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:19.409527 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:19.409642 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:19.409749 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 08:34:19.409900 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":152,"threads_started":1}
I20260808 08:34:19.413555 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:19.413967 16791 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73d1066dbf444ee8b62963f97010ac1c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35113 } }
I20260808 08:34:19.414258 16791 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:19.414315 16791 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d1066dbf444ee8b62963f97010ac1c, State: Initialized, Role: FOLLOWER
I20260808 08:34:19.414808 16791 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73d1066dbf444ee8b62963f97010ac1c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35113 } }
I20260808 08:34:19.415043 16791 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:19.415138 16791 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:19.415247 16791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:19.416484 16791 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73d1066dbf444ee8b62963f97010ac1c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35113 } }
I20260808 08:34:19.416899 16791 leader_election.cc:302] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73d1066dbf444ee8b62963f97010ac1c; no voters:
I20260808 08:34:19.417268 16791 leader_election.cc:288] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:19.417344 16802 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:19.417574 16802 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [term 1 LEADER]: Becoming Leader. State: Replica: 73d1066dbf444ee8b62963f97010ac1c, State: Running, Role: LEADER
I20260808 08:34:19.417788 16795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:19.415938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51601 (local address 127.25.170.62:35113)
0808 08:34:19.416043 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:19.416048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:19.416285 (+ 237us) server_negotiation.cc:407] Connection header received
0808 08:34:19.416428 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:19.416430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:19.416459 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:19.416517 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:19.417229 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:19.417232 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:19.417234 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:19.417244 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:19.417268 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:19.417278 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:19.417383 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:19.417646 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 08:34:19.417687 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 08:34:19.417912 16802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73d1066dbf444ee8b62963f97010ac1c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35113 } }
I20260808 08:34:19.418571 16791 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:19.419107 16802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73d1066dbf444ee8b62963f97010ac1c. Latest consensus state: current_term: 1 leader_uuid: "73d1066dbf444ee8b62963f97010ac1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73d1066dbf444ee8b62963f97010ac1c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35113 } } }
I20260808 08:34:19.419234 16802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:19.419500 16802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73d1066dbf444ee8b62963f97010ac1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73d1066dbf444ee8b62963f97010ac1c" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35113 } } }
I20260808 08:34:19.419661 16802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:19.420089 16809 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:19.422873 16809 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:19.428771 16809 catalog_manager.cc:1347] Generated new cluster ID: cdfc49c158454e44ab7387d860167c44
I20260808 08:34:19.428833 16809 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:19.443456 16809 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:19.443774 16809 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:19.460173 16809 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73d1066dbf444ee8b62963f97010ac1c: Generated new TSK 0
I20260808 08:34:19.461015 16809 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:19.464726 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 16717
2026-08-08T08:34:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1420 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:19 dist-test-slave-zkpd krb5kdc[16825](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:19 dist-test-slave-zkpd krb5kdc[16825](info): set up 2 sockets
Aug 08 08:34:19 dist-test-slave-zkpd krb5kdc[16825](info): commencing operation
krb5kdc: starting...
W20260808 08:34:20.526051 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:20 dist-test-slave-zkpd krb5kdc[16825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:34:20.666564 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:35467
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:38811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:35467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:20.798800 16838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:20.799126 16838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:20.799170 16838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:20.803418 16838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:20.803510 16838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:20.803531 16838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:20.803547 16838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:20.803563 16838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:20.809119 16838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:38811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:35467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:35467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:20.810283 16838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:20.811345 16838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:20.820295 16843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:20.820308 16844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:20.820308 16846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:20.820359 16838 server_base.cc:1034] running on GCE node
I20260808 08:34:20.821264 16838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:20.822441 16838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:20.823645 16838 hybrid_clock.cc:648] HybridClock initialized: now 1786178060823607 us; error 57 us; skew 500 ppm
Aug 08 08:34:20 dist-test-slave-zkpd krb5kdc[16825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178060, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:20.826727 16838 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:34:20.827832 16838 webserver.cc:460] Webserver started at http://127.25.170.62:36093/ using document root <none> and password file <none>
I20260808 08:34:20.828687 16838 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:20.828804 16838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:20.829120 16838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:20.832228 16838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "b8168255eb0347e2811ec7481b299331"
format_stamp: "Formatted at 2026-08-08 08:34:20 on dist-test-slave-zkpd"
server_key: "f935676efa095870f9d5381be895dd32"
server_key_iv: "f24b508c103ac36c9c1c959f07103fc5"
server_key_version: "encryptionkey@0"
I20260808 08:34:20.832804 16838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "b8168255eb0347e2811ec7481b299331"
format_stamp: "Formatted at 2026-08-08 08:34:20 on dist-test-slave-zkpd"
server_key: "f935676efa095870f9d5381be895dd32"
server_key_iv: "f24b508c103ac36c9c1c959f07103fc5"
server_key_version: "encryptionkey@0"
I20260808 08:34:20.836956 16838 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:34:20.839529 16854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:20.840986 16838 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:20.841149 16838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "b8168255eb0347e2811ec7481b299331"
format_stamp: "Formatted at 2026-08-08 08:34:20 on dist-test-slave-zkpd"
server_key: "f935676efa095870f9d5381be895dd32"
server_key_iv: "f24b508c103ac36c9c1c959f07103fc5"
server_key_version: "encryptionkey@0"
I20260808 08:34:20.841288 16838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:20.862113 16838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:20.865475 16838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:20.865728 16838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:20.873580 16838 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:35467
I20260808 08:34:20.873603 16909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:35467 every 8 connection(s)
I20260808 08:34:20.874650 16838 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:20.876092 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 16838
I20260808 08:34:20.876277 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:20.876585 26280 external_mini_cluster.cc:1428] Setting key d31f4d44d023725ad3ff1231c2bff718
I20260808 08:34:20.877903 16910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:20.885039 16910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331: Bootstrap starting.
Aug 08 08:34:20 dist-test-slave-zkpd krb5kdc[16825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:34:20.887833 16910 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:20.888644 16910 log.cc:824] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:20.890689 16910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331: No bootstrap required, opened a new log
I20260808 08:34:20.892565 16913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.878170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39775 (local address 127.25.170.62:35467)
0808 08:34:20.878643 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:20.878664 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:20.878708 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:34:20.879582 (+ 874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:20.879606 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:20.880067 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:20.880447 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:20.881202 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.882728 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.883642 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.884389 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.884543 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.887352 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:20.887366 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:20.887384 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:20.887418 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:20.889439 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.889917 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.889922 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.889927 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.890060 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.890384 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.890394 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.890396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.890880 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:20.891090 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:20.891405 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 08:34:20.891716 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":144,"threads_started":1}
I20260808 08:34:20.894958 16910 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8168255eb0347e2811ec7481b299331" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35467 } }
I20260808 08:34:20.895265 16910 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:20.895330 16910 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8168255eb0347e2811ec7481b299331, State: Initialized, Role: FOLLOWER
I20260808 08:34:20.895759 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:20.895836 16910 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8168255eb0347e2811ec7481b299331" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35467 } }
I20260808 08:34:20.896060 16910 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:20.896140 16910 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:20.896240 16910 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:20.897298 16910 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8168255eb0347e2811ec7481b299331" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35467 } }
I20260808 08:34:20.897651 16910 leader_election.cc:302] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8168255eb0347e2811ec7481b299331; no voters:
I20260808 08:34:20.898010 16910 leader_election.cc:288] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:20.898093 16919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:20.898280 16919 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [term 1 LEADER]: Becoming Leader. State: Replica: b8168255eb0347e2811ec7481b299331, State: Running, Role: LEADER
I20260808 08:34:20.898664 16919 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8168255eb0347e2811ec7481b299331" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35467 } }
I20260808 08:34:20.899405 16910 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:20.900439 16922 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8168255eb0347e2811ec7481b299331. Latest consensus state: current_term: 1 leader_uuid: "b8168255eb0347e2811ec7481b299331" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8168255eb0347e2811ec7481b299331" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35467 } } }
I20260808 08:34:20.900846 16922 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:20.900725 16921 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8168255eb0347e2811ec7481b299331" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8168255eb0347e2811ec7481b299331" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 35467 } } }
I20260808 08:34:20.901197 16921 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:20.901525 16931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:20.905190 16931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:20.908293 16913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.898380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44189 (local address 127.25.170.62:35467)
0808 08:34:20.898494 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:20.898498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:20.898732 (+ 234us) server_negotiation.cc:407] Connection header received
0808 08:34:20.898925 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:20.898930 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:20.898974 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:20.899026 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:20.899863 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.900794 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.902293 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.902618 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.902757 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.904541 (+ 1784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:20.904545 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:20.904549 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:20.904580 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:20.906402 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.906934 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.906938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.906940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.907033 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.907345 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.907349 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.907351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.907556 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:20.907709 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:20.907986 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 08:34:20.908110 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":42}
I20260808 08:34:20.911492 16931 catalog_manager.cc:1347] Generated new cluster ID: 19a57159f48e45208baa5277ffde3dd3
I20260808 08:34:20.911638 16931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:20.937633 16931 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:20.939038 16931 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:20.949728 16931 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8168255eb0347e2811ec7481b299331: Generated new TSK 0
I20260808 08:34:20.950676 16931 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:20.964605 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 16838
2026-08-08T08:34:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1500 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:21 dist-test-slave-zkpd krb5kdc[16944](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:21 dist-test-slave-zkpd krb5kdc[16944](info): set up 2 sockets
Aug 08 08:34:21 dist-test-slave-zkpd krb5kdc[16944](info): commencing operation
krb5kdc: starting...
W20260808 08:34:22.057857 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:22 dist-test-slave-zkpd krb5kdc[16944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:34:22.198589 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:45917
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:44139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:45917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:22.308905 16958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:22.309140 16958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:22.309177 16958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:22.313103 16958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:22.313153 16958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:22.313172 16958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:22.313239 16958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:22.313262 16958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:22.318696 16958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:44139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:45917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:45917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:22.319731 16958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:22.320758 16958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:22.329675 16963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:22.329694 16964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:22.329682 16966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:22.330021 16958 server_base.cc:1034] running on GCE node
I20260808 08:34:22.330570 16958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:22.331584 16958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:22.332743 16958 hybrid_clock.cc:648] HybridClock initialized: now 1786178062332728 us; error 26 us; skew 500 ppm
Aug 08 08:34:22 dist-test-slave-zkpd krb5kdc[16944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178062, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:22.335547 16958 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:34:22.336486 16958 webserver.cc:460] Webserver started at http://127.25.170.62:36227/ using document root <none> and password file <none>
I20260808 08:34:22.337061 16958 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:22.337153 16958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:22.337417 16958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:22.339409 16958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "9f929c3b1c7d454591e14cb695db6428"
format_stamp: "Formatted at 2026-08-08 08:34:22 on dist-test-slave-zkpd"
server_key: "5d9eeb487d146d0d85bbb49155b4d34b"
server_key_iv: "206a242e24f0464c9e410aecb55240fa"
server_key_version: "encryptionkey@0"
I20260808 08:34:22.340039 16958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "9f929c3b1c7d454591e14cb695db6428"
format_stamp: "Formatted at 2026-08-08 08:34:22 on dist-test-slave-zkpd"
server_key: "5d9eeb487d146d0d85bbb49155b4d34b"
server_key_iv: "206a242e24f0464c9e410aecb55240fa"
server_key_version: "encryptionkey@0"
I20260808 08:34:22.343601 16958 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:22.346061 16973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:22.347298 16958 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:34:22.347435 16958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "9f929c3b1c7d454591e14cb695db6428"
format_stamp: "Formatted at 2026-08-08 08:34:22 on dist-test-slave-zkpd"
server_key: "5d9eeb487d146d0d85bbb49155b4d34b"
server_key_iv: "206a242e24f0464c9e410aecb55240fa"
server_key_version: "encryptionkey@0"
I20260808 08:34:22.347561 16958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:22.358451 16958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:22.361163 16958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:22.361358 16958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:22.368652 16958 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:45917
I20260808 08:34:22.368685 17025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:45917 every 8 connection(s)
I20260808 08:34:22.369563 16958 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:22.372248 17026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:22.374531 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 16958
I20260808 08:34:22.374672 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:22.374918 26280 external_mini_cluster.cc:1428] Setting key 77b4c162573e4727af919ebb7f9ef961
I20260808 08:34:22.378087 17026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428: Bootstrap starting.
I20260808 08:34:22.380334 17026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:22.381062 17026 log.cc:824] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:22.383180 17026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428: No bootstrap required, opened a new log
I20260808 08:34:22.383752 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.376325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52793 (local address 127.25.170.62:45917)
0808 08:34:22.376776 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:22.376790 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:22.376825 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:34:22.377434 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:22.377449 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:22.377763 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:22.378094 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:22.378487 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.379441 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.380417 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.380913 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.381090 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.382024 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:22.382029 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:22.382042 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:22.382399 (+ 357us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:22.382445 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:22.382466 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:22.382544 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:22.382723 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 08:34:22.382962 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":138,"threads_started":1}
I20260808 08:34:22.386584 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:22.387269 17026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f929c3b1c7d454591e14cb695db6428" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45917 } }
I20260808 08:34:22.387498 17026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:22.387576 17026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f929c3b1c7d454591e14cb695db6428, State: Initialized, Role: FOLLOWER
I20260808 08:34:22.388080 17026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f929c3b1c7d454591e14cb695db6428" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45917 } }
I20260808 08:34:22.388250 17026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:22.388335 17026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:22.388475 17026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:22.389665 17026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f929c3b1c7d454591e14cb695db6428" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45917 } }
I20260808 08:34:22.390007 17026 leader_election.cc:302] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f929c3b1c7d454591e14cb695db6428; no voters:
I20260808 08:34:22.390362 17026 leader_election.cc:288] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:22.390475 17036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:22.390724 17036 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [term 1 LEADER]: Becoming Leader. State: Replica: 9f929c3b1c7d454591e14cb695db6428, State: Running, Role: LEADER
I20260808 08:34:22.391090 17036 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f929c3b1c7d454591e14cb695db6428" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45917 } }
I20260808 08:34:22.391607 17026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:22.392593 17036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f929c3b1c7d454591e14cb695db6428. Latest consensus state: current_term: 1 leader_uuid: "9f929c3b1c7d454591e14cb695db6428" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f929c3b1c7d454591e14cb695db6428" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45917 } } }
I20260808 08:34:22.392798 17036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:22.393028 17038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f929c3b1c7d454591e14cb695db6428" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f929c3b1c7d454591e14cb695db6428" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 45917 } } }
I20260808 08:34:22.393123 17038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:22.393383 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.388684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50541 (local address 127.25.170.62:45917)
0808 08:34:22.388826 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:22.388830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:22.389014 (+ 184us) server_negotiation.cc:407] Connection header received
0808 08:34:22.389128 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:22.389129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:22.389163 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:22.389224 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:22.389528 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.390102 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.391308 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.391617 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.391715 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.392738 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:22.392743 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:22.392746 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:22.392760 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:22.392787 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:22.392800 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:22.392852 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:22.393046 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 08:34:22.393112 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:34:22.393626 17046 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:22.396418 17046 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:22.401214 17046 catalog_manager.cc:1347] Generated new cluster ID: 5e765a4fe27d478ea6d175b0be14d18c
I20260808 08:34:22.401284 17046 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:22.413890 17046 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:22.415107 17046 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:22.422356 17046 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f929c3b1c7d454591e14cb695db6428: Generated new TSK 0
I20260808 08:34:22.423128 17046 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:22.431385 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 16958
2026-08-08T08:34:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1465 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:22 dist-test-slave-zkpd krb5kdc[17058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:22 dist-test-slave-zkpd krb5kdc[17058](info): set up 2 sockets
Aug 08 08:34:22 dist-test-slave-zkpd krb5kdc[17058](info): commencing operation
krb5kdc: starting...
W20260808 08:34:23.494340 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:23 dist-test-slave-zkpd krb5kdc[17058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:34:23.618554 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33777
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:42441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:33777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:23.727232 17071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:23.727540 17071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:23.727617 17071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:23.731586 17071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:23.731679 17071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:23.731719 17071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:23.731757 17071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:23.731794 17071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:23.736981 17071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:42441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:33777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:23.738128 17071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:23.739157 17071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:23.747740 17077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:23.747738 17078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:23.747812 17080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:23.748020 17071 server_base.cc:1034] running on GCE node
I20260808 08:34:23.748660 17071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:23.749692 17071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:23.750893 17071 hybrid_clock.cc:648] HybridClock initialized: now 1786178063750874 us; error 32 us; skew 500 ppm
Aug 08 08:34:23 dist-test-slave-zkpd krb5kdc[17058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178063, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:23.753753 17071 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:34:23.754662 17071 webserver.cc:460] Webserver started at http://127.25.170.62:35471/ using document root <none> and password file <none>
I20260808 08:34:23.755201 17071 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:23.755292 17071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:23.755520 17071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:23.757598 17071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "3efc2bf6103f4e82b784f948e107e125"
format_stamp: "Formatted at 2026-08-08 08:34:23 on dist-test-slave-zkpd"
server_key: "f05d525bf67cde496542fdb9e7473c93"
server_key_iv: "2fa52e2f29fab2d15e305896e833c781"
server_key_version: "encryptionkey@0"
I20260808 08:34:23.758189 17071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "3efc2bf6103f4e82b784f948e107e125"
format_stamp: "Formatted at 2026-08-08 08:34:23 on dist-test-slave-zkpd"
server_key: "f05d525bf67cde496542fdb9e7473c93"
server_key_iv: "2fa52e2f29fab2d15e305896e833c781"
server_key_version: "encryptionkey@0"
I20260808 08:34:23.761785 17071 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260808 08:34:23.764101 17090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:23.765285 17071 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:34:23.765421 17071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "3efc2bf6103f4e82b784f948e107e125"
format_stamp: "Formatted at 2026-08-08 08:34:23 on dist-test-slave-zkpd"
server_key: "f05d525bf67cde496542fdb9e7473c93"
server_key_iv: "2fa52e2f29fab2d15e305896e833c781"
server_key_version: "encryptionkey@0"
I20260808 08:34:23.765527 17071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:23.769922 17071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:23.772783 17071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:23.772979 17071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:23.780030 17071 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:33777
I20260808 08:34:23.780061 17144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:33777 every 8 connection(s)
I20260808 08:34:23.780917 17071 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:23.783525 17145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:23.784340 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 17071
I20260808 08:34:23.784493 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:23.784761 26280 external_mini_cluster.cc:1428] Setting key da777871dc56f4634f68d793cd6d16b9
I20260808 08:34:23.790238 17148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.786062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55569 (local address 127.25.170.62:33777)
0808 08:34:23.786494 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.786512 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.786556 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:34:23.787388 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.787411 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.787780 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.788177 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.788887 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.788893 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.788909 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:23.788920 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.788981 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:23.789007 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.789150 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.789222 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.789381 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":103,"threads_started":1}
I20260808 08:34:23.790414 17145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125: Bootstrap starting.
I20260808 08:34:23.792923 17145 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:23.792929 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:23.793664 17145 log.cc:824] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:23.795785 17145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125: No bootstrap required, opened a new log
I20260808 08:34:23.796741 17148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.795133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54581 (local address 127.25.170.62:33777)
0808 08:34:23.795244 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.795248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.795451 (+ 203us) server_negotiation.cc:407] Connection header received
0808 08:34:23.795530 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.795533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.795567 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.795643 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.796370 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.796374 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.796376 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:23.796388 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.796413 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:23.796425 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.796515 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.796588 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.796623 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 08:34:23.799412 17145 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efc2bf6103f4e82b784f948e107e125" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33777 } }
I20260808 08:34:23.799614 17145 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:23.799688 17145 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3efc2bf6103f4e82b784f948e107e125, State: Initialized, Role: FOLLOWER
I20260808 08:34:23.800163 17145 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efc2bf6103f4e82b784f948e107e125" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33777 } }
I20260808 08:34:23.800313 17145 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:23.800402 17145 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:23.800516 17145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:23.801375 17145 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efc2bf6103f4e82b784f948e107e125" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33777 } }
I20260808 08:34:23.801703 17145 leader_election.cc:302] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3efc2bf6103f4e82b784f948e107e125; no voters:
I20260808 08:34:23.802012 17145 leader_election.cc:288] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:23.802085 17155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:23.802314 17155 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [term 1 LEADER]: Becoming Leader. State: Replica: 3efc2bf6103f4e82b784f948e107e125, State: Running, Role: LEADER
I20260808 08:34:23.802640 17155 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efc2bf6103f4e82b784f948e107e125" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33777 } }
I20260808 08:34:23.803258 17145 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:23.804337 17157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3efc2bf6103f4e82b784f948e107e125" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efc2bf6103f4e82b784f948e107e125" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33777 } } }
I20260808 08:34:23.804463 17157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:23.804780 17156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3efc2bf6103f4e82b784f948e107e125. Latest consensus state: current_term: 1 leader_uuid: "3efc2bf6103f4e82b784f948e107e125" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efc2bf6103f4e82b784f948e107e125" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33777 } } }
I20260808 08:34:23.804869 17164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:23.804961 17156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:23.808183 17164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:23.813382 17164 catalog_manager.cc:1347] Generated new cluster ID: 6ad2348bfbda4c0e8302a417e19499f5
I20260808 08:34:23.813445 17164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:23.846607 17164 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:23.846913 17164 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:23.856746 17164 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3efc2bf6103f4e82b784f948e107e125: Generated new TSK 0
I20260808 08:34:23.857393 17164 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:23.867704 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 17071
2026-08-08T08:34:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1435 ms)
[----------] 18 tests from AuthTokenIssuingTest (26015 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:23 dist-test-slave-zkpd krb5kdc[17176](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:23 dist-test-slave-zkpd krb5kdc[17176](info): set up 2 sockets
Aug 08 08:34:23 dist-test-slave-zkpd krb5kdc[17176](info): commencing operation
krb5kdc: starting...
W20260808 08:34:24.937968 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:34:25.065186 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:44057
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:44057,127.25.170.61:46461,127.25.170.60:37025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:25.177357 17192 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:34:25.177623 17192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:25.177646 17192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:25.177758 17192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:25.181852 17192 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:25.181902 17192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:25.181950 17192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:25.181988 17192 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:25.182026 17192 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:25.187196 17192 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:44057,127.25.170.61:46461,127.25.170.60:37025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:44057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:25.188248 17192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:25.189278 17192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:25.198051 17197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:25.198051 17200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:25.198199 17198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:25.198760 17192 server_base.cc:1034] running on GCE node
I20260808 08:34:25.199304 17192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:25.200510 17192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:25.201701 17192 hybrid_clock.cc:648] HybridClock initialized: now 1786178065201689 us; error 41 us; skew 500 ppm
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:25.204507 17192 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:34:25.205371 17192 webserver.cc:460] Webserver started at http://127.25.170.62:43551/ using document root <none> and password file <none>
I20260808 08:34:25.205919 17192 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:25.206008 17192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:25.206244 17192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:25.208418 17192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24"
format_stamp: "Formatted at 2026-08-08 08:34:25 on dist-test-slave-zkpd"
server_key: "9a4026e84d71269216a9da20af7da498"
server_key_iv: "b83ba6526b1e685d02d20bbd53953644"
server_key_version: "encryptionkey@0"
I20260808 08:34:25.208992 17192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24"
format_stamp: "Formatted at 2026-08-08 08:34:25 on dist-test-slave-zkpd"
server_key: "9a4026e84d71269216a9da20af7da498"
server_key_iv: "b83ba6526b1e685d02d20bbd53953644"
server_key_version: "encryptionkey@0"
I20260808 08:34:25.212757 17192 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:25.215090 17208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:25.216362 17192 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:34:25.216503 17192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24"
format_stamp: "Formatted at 2026-08-08 08:34:25 on dist-test-slave-zkpd"
server_key: "9a4026e84d71269216a9da20af7da498"
server_key_iv: "b83ba6526b1e685d02d20bbd53953644"
server_key_version: "encryptionkey@0"
I20260808 08:34:25.216611 17192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:25.238129 17192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:25.241057 17192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:25.241366 17192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:25.248587 17192 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:44057
I20260808 08:34:25.248890 17261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:44057 every 8 connection(s)
I20260808 08:34:25.249536 17192 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:25.251614 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 17192
I20260808 08:34:25.251760 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:25.252082 26280 external_mini_cluster.cc:1428] Setting key b06a0cc2675b0cb83c83f00a85578eb2
I20260808 08:34:25.252429 17262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:25.256098 17262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.25.170.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.61@KRBTEST.COM" created.
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:34:25.271823 17266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.258269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37028 (local address 127.25.170.62:44057)
0808 08:34:25.258860 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.258872 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.258932 (+ 60us) server_negotiation.cc:407] Connection header received
0808 08:34:25.260097 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.260103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.260373 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.260587 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.261412 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.262412 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.263476 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.263970 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.264162 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.266672 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.266682 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.266698 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.266729 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.268487 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.269151 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.269156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.269157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.269281 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.269618 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.269623 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.269625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.269998 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.270136 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.270513 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.270767 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":168,"threads_started":1}
I20260808 08:34:25.271823 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.258268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:44057 (local address 127.0.0.1:37028)
0808 08:34:25.258722 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.258773 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.259716 (+ 943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.260609 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.260613 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.260955 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:25.261223 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.261235 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.262547 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.262550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.263317 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.263326 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.264149 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.264153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.264273 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.264842 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:25.264868 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:25.266508 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:25.268605 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.268618 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.268631 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.269032 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.269395 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.269398 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.269400 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.269516 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.270120 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:25.270126 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:25.270271 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.270438 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.270825 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":115,"thread_start_us":122,"threads_started":1}
I20260808 08:34:25.274379 17262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:25.275161 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.274855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:46461 (local address 127.0.0.1:53598)
0808 08:34:25.275027 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.275098 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:46461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 08:34:25.275427 17211 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.170.61:46461: connect: Connection refused (error 111)
I20260808 08:34:25.276376 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.276178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:46461 (local address 127.0.0.1:53612)
0808 08:34:25.276279 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.276325 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:46461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 08:34:25.276566 17262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.61:46461: Network error: Client connection negotiation failed: client connection to 127.25.170.61:46461: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab.
Entry for principal kudu/127.25.170.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab.
I20260808 08:34:25.282740 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.61:46461
--webserver_interface=127.25.170.61
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab
--principal=kudu/127.25.170.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:44057,127.25.170.61:46461,127.25.170.60:37025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:34:25.325821 17262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } attempt: 1
I20260808 08:34:25.326694 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.326390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:46461 (local address 127.0.0.1:53626)
0808 08:34:25.326542 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.326615 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:46461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 08:34:25.327435 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.327220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:46461 (local address 127.0.0.1:53628)
0808 08:34:25.327329 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.327382 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:46461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:34:25.327562 17262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.61:46461: Network error: Client connection negotiation failed: client connection to 127.25.170.61:46461: connect: Connection refused (error 111)
W20260808 08:34:25.395429 17269 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:34:25.395726 17269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:25.395799 17269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:25.395877 17269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 08:34:25.395756 17262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } attempt: 2
I20260808 08:34:25.396625 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.396338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:46461 (local address 127.0.0.1:53634)
0808 08:34:25.396487 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.396546 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:46461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 08:34:25.397392 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.397151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:46461 (local address 127.0.0.1:53642)
0808 08:34:25.397283 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.397336 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:46461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:34:25.397518 17262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.61:46461: Network error: Client connection negotiation failed: client connection to 127.25.170.61:46461: connect: Connection refused (error 111)
W20260808 08:34:25.400151 17269 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:25.400224 17269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:25.400272 17269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:25.400336 17269 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:25.400373 17269 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:25.405515 17269 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:44057,127.25.170.61:46461,127.25.170.60:37025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab
--principal=kudu/127.25.170.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.61:46461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.170.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:25.406504 17269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:25.407501 17269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:25.415689 17275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:25.415704 17274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:25.415756 17278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:25.416106 17269 server_base.cc:1034] running on GCE node
I20260808 08:34:25.416639 17269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:25.417672 17269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:25.418866 17269 hybrid_clock.cc:648] HybridClock initialized: now 1786178065418848 us; error 29 us; skew 500 ppm
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:25.421648 17269 init.cc:377] Logged in from keytab as kudu/127.25.170.61@KRBTEST.COM (short username kudu)
I20260808 08:34:25.422482 17269 webserver.cc:460] Webserver started at http://127.25.170.61:43373/ using document root <none> and password file <none>
I20260808 08:34:25.423033 17269 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:25.423125 17269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:25.423352 17269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:25.425815 17269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/data/instance:
uuid: "d3dad3f1b8a3459f95b7c5451a70b08d"
format_stamp: "Formatted at 2026-08-08 08:34:25 on dist-test-slave-zkpd"
server_key: "a51162568108bb4fdd6bba4c50630e2e"
server_key_iv: "f841537bce61947b59e64c7998f555de"
server_key_version: "encryptionkey@0"
I20260808 08:34:25.426419 17269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/wal/instance:
uuid: "d3dad3f1b8a3459f95b7c5451a70b08d"
format_stamp: "Formatted at 2026-08-08 08:34:25 on dist-test-slave-zkpd"
server_key: "a51162568108bb4fdd6bba4c50630e2e"
server_key_iv: "f841537bce61947b59e64c7998f555de"
server_key_version: "encryptionkey@0"
I20260808 08:34:25.430197 17269 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 08:34:25.432572 17285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:25.433813 17269 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:34:25.433966 17269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/wal
uuid: "d3dad3f1b8a3459f95b7c5451a70b08d"
format_stamp: "Formatted at 2026-08-08 08:34:25 on dist-test-slave-zkpd"
server_key: "a51162568108bb4fdd6bba4c50630e2e"
server_key_iv: "f841537bce61947b59e64c7998f555de"
server_key_version: "encryptionkey@0"
I20260808 08:34:25.434077 17269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:25.462589 17269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:25.466936 17269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:25.467139 17269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:25.474254 17269 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.61:46461
I20260808 08:34:25.474534 17339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.61:46461 every 8 connection(s)
I20260808 08:34:25.475244 17269 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
I20260808 08:34:25.478057 17340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:25.479707 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 17269
I20260808 08:34:25.479840 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-1/wal/instance
I20260808 08:34:25.480134 26280 external_mini_cluster.cc:1428] Setting key 8f3b487cab229165f74190667a492404
I20260808 08:34:25.482033 17340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:25.488680 17262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } attempt: 3
WARNING: no policy specified for kudu/127.25.170.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.60@KRBTEST.COM" created.
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
I20260808 08:34:25.499044 17266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.484430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37032 (local address 127.25.170.62:44057)
0808 08:34:25.484593 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.484598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.485549 (+ 951us) server_negotiation.cc:407] Connection header received
0808 08:34:25.486952 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.486955 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.487005 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.487081 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.488727 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.489516 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.490908 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.491266 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.491368 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.494132 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.494139 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.494145 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.494182 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.495948 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.496608 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.496613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.496616 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.496717 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.497145 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.497150 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.497153 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.497381 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.497478 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.498769 (+ 1291us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.498892 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:34:25.499475 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.484791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:44057 (local address 127.0.0.1:37032)
0808 08:34:25.485347 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.485410 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.486725 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.487265 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.487273 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.487745 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:25.488507 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.488529 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.489653 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.489657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.490761 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.490773 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.491422 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.491425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.491575 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.492249 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:25.492265 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:25.493977 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:25.496051 (+ 2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.496064 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.496076 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.496492 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.496807 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.496810 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.496812 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.497014 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.497533 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:25.497539 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:25.497883 (+ 344us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.498077 (+ 194us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.498407 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":114,"threads_started":1}
I20260808 08:34:25.500022 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.489146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:46461 (local address 127.0.0.1:53648)
0808 08:34:25.489343 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.489357 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.489428 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.490350 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.490353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.490543 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:25.490637 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.490643 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.491981 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.491989 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.492653 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.492662 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.493415 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.493419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.493552 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.494090 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:25.494109 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:25.495612 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:25.498006 (+ 2394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.498009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.498011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.498247 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.498626 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.498631 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.498634 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.498738 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.499370 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:25.499375 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:25.499492 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.499591 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.499761 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133}
I20260808 08:34:25.500846 17344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.489595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53648 (local address 127.25.170.61:46461)
0808 08:34:25.489973 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.489983 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.490002 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:34:25.490037 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.490041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.490185 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.490363 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.490761 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.491746 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.492777 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.493266 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.493400 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.495772 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.495777 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.495787 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.495808 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.497883 (+ 2075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.498389 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.498398 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.498403 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.498497 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.498886 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.498891 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.498896 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.499228 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.500356 (+ 1128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.500474 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.500620 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":200,"threads_started":1}
I20260808 08:34:25.500963 17340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:25.502645 17262 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:25.503372 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.503128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49222)
0808 08:34:25.503258 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.503309 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 08:34:25.504069 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.503807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49232)
0808 08:34:25.503961 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.504010 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260808 08:34:25.504199 17262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:37025: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
I20260808 08:34:25.509805 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.501663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:46461 (local address 127.0.0.1:53650)
0808 08:34:25.501745 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.501758 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.501830 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.502683 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.502686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.502837 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:25.502948 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.502957 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.503794 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.503800 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.504519 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.504530 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.505045 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.505048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.505170 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.505552 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:25.505563 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:25.506764 (+ 1201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:25.508383 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.508386 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.508408 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.508602 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.508899 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.508901 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.508902 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.508973 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.509352 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:25.509355 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:25.509434 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.509516 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.509625 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":18}
I20260808 08:34:25.509858 17344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.501793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53650 (local address 127.25.170.61:46461)
0808 08:34:25.502458 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.502464 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.502481 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:34:25.502519 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.502525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.502566 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.502650 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.503045 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.503662 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.504639 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.504881 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.505036 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.506902 (+ 1866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.506905 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.506907 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.506927 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.508265 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.508676 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.508678 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.508679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.508808 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.509038 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.509040 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.509041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.509193 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.509325 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.509582 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.509689 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":582}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab.
Entry for principal kudu/127.25.170.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab.
I20260808 08:34:25.510455 17340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:25.511060 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.60:37025
--webserver_interface=127.25.170.60
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab
--principal=kudu/127.25.170.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:44057,127.25.170.61:46461,127.25.170.60:37025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:34:25.511094 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.510861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49248)
0808 08:34:25.510968 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.511046 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:34:25.511812 17286 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
I20260808 08:34:25.512794 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.512510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49256)
0808 08:34:25.512643 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.512716 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 08:34:25.512948 17340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:37025: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
I20260808 08:34:25.535358 17262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } attempt: 1
I20260808 08:34:25.536105 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.535782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49262)
0808 08:34:25.535954 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.536017 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 08:34:25.536950 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.536690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49266)
0808 08:34:25.536814 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.536866 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 08:34:25.537082 17262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:37025: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
I20260808 08:34:25.562223 17340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } attempt: 1
I20260808 08:34:25.563043 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.562753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49278)
0808 08:34:25.562897 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.562966 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 08:34:25.563845 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.563627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49288)
0808 08:34:25.563741 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.563786 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:34:25.564059 17340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:37025: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
I20260808 08:34:25.612241 17262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } attempt: 2
I20260808 08:34:25.613116 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.612771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49302)
0808 08:34:25.612948 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.613020 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 08:34:25.613896 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.613640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49312)
0808 08:34:25.613773 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.613828 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 08:34:25.614055 17262 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:37025: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
W20260808 08:34:25.625063 17347 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:34:25.625327 17347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:25.625351 17347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:25.625451 17347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:25.629438 17347 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:25.629484 17347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:25.629504 17347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:25.629521 17347 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:25.629577 17347 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:25.632242 17340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } attempt: 2
I20260808 08:34:25.633041 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.632765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49316)
0808 08:34:25.632911 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.632971 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 08:34:25.633774 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.633552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49320)
0808 08:34:25.633659 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.633721 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:34:25.633890 17340 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:37025: Network error: Client connection negotiation failed: client connection to 127.25.170.60:37025: connect: Connection refused (error 111)
I20260808 08:34:25.635102 17347 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:44057,127.25.170.61:46461,127.25.170.60:37025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab
--principal=kudu/127.25.170.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.60:37025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.170.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:25.636193 17347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:25.637181 17347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:25.645511 17353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:25.645503 17356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:25.645553 17354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:25.645730 17347 server_base.cc:1034] running on GCE node
I20260808 08:34:25.646413 17347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:25.647487 17347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:25.648671 17347 hybrid_clock.cc:648] HybridClock initialized: now 1786178065648664 us; error 34 us; skew 500 ppm
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:25.651364 17347 init.cc:377] Logged in from keytab as kudu/127.25.170.60@KRBTEST.COM (short username kudu)
I20260808 08:34:25.652235 17347 webserver.cc:460] Webserver started at http://127.25.170.60:39527/ using document root <none> and password file <none>
I20260808 08:34:25.652767 17347 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:25.652865 17347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:25.653093 17347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:25.655097 17347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/data/instance:
uuid: "b8284de6dc834180b252408e1eab5500"
format_stamp: "Formatted at 2026-08-08 08:34:25 on dist-test-slave-zkpd"
server_key: "852c49142bcaad5c15ee000268b3c155"
server_key_iv: "01ead9c39b45c6a383d16e6ddcb59444"
server_key_version: "encryptionkey@0"
I20260808 08:34:25.655673 17347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/wal/instance:
uuid: "b8284de6dc834180b252408e1eab5500"
format_stamp: "Formatted at 2026-08-08 08:34:25 on dist-test-slave-zkpd"
server_key: "852c49142bcaad5c15ee000268b3c155"
server_key_iv: "01ead9c39b45c6a383d16e6ddcb59444"
server_key_version: "encryptionkey@0"
I20260808 08:34:25.659456 17347 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:34:25.661934 17363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:25.663189 17347 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:34:25.663339 17347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/wal
uuid: "b8284de6dc834180b252408e1eab5500"
format_stamp: "Formatted at 2026-08-08 08:34:25 on dist-test-slave-zkpd"
server_key: "852c49142bcaad5c15ee000268b3c155"
server_key_iv: "01ead9c39b45c6a383d16e6ddcb59444"
server_key_version: "encryptionkey@0"
I20260808 08:34:25.663452 17347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:25.678854 17347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:25.682122 17347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:25.682328 17347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:25.689597 17347 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.60:37025
I20260808 08:34:25.689940 17416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.60:37025 every 8 connection(s)
I20260808 08:34:25.690596 17347 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
I20260808 08:34:25.693356 17417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:25.697172 17417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:25.697578 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 17347
I20260808 08:34:25.697713 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786177786507378-26280-0/minicluster-data/master-2/wal/instance
I20260808 08:34:25.697991 26280 external_mini_cluster.cc:1428] Setting key af06633e01e087763fc42a284299eb7f
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
I20260808 08:34:25.710474 17266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.699203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37044 (local address 127.25.170.62:44057)
0808 08:34:25.699335 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.699339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.700036 (+ 697us) server_negotiation.cc:407] Connection header received
0808 08:34:25.700873 (+ 837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.700876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.700924 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.700998 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.701956 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.702494 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.703567 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.703840 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.703979 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.706612 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.706615 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.706618 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.706641 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.708363 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.708956 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.708959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.708961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.709045 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.709393 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.709398 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.709400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.709599 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.709711 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.710178 (+ 467us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.710298 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:34:25.711481 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.699280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:44057 (local address 127.0.0.1:37044)
0808 08:34:25.699860 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.699932 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.700657 (+ 725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.701075 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.701080 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.701526 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:25.701804 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.701819 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.702616 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.702619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.703447 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.703457 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.704020 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.704024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.704200 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.704832 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:25.704848 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:25.706399 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:25.708478 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.708489 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.708499 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.708842 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.709141 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.709144 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.709146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.709287 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.709711 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:25.709719 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:25.709963 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.710131 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.710434 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":127,"threads_started":1}
I20260808 08:34:25.711488 17421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.699280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49328 (local address 127.25.170.60:37025)
0808 08:34:25.699809 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.699827 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.699866 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:34:25.700657 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.700680 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.700918 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.701099 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.701820 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.702812 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.703730 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.704246 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.704365 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.706949 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.706955 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.706964 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.706998 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.708867 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.709313 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.709318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.709319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.709392 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.709678 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.709681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.709683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.709997 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.710197 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.710498 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.710634 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"spinlock_wait_cycles":21376,"thread_start_us":161,"threads_started":1}
I20260808 08:34:25.712940 17417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:25.713248 17262 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } attempt: 3
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:34:25.723191 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.713469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:46461 (local address 127.0.0.1:53660)
0808 08:34:25.714605 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.714620 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.714698 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.714965 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.714968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.715125 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:25.715220 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.715226 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.716219 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.716223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.716857 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.716868 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.717592 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.717596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.717693 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.718111 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:25.718127 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:25.719540 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:25.721598 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.721603 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.721605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.721862 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.722170 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.722172 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.722174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.722264 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.722708 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:25.722709 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:25.722780 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.722890 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.723015 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1051}
I20260808 08:34:25.723407 17344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.713736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53660 (local address 127.25.170.61:46461)
0808 08:34:25.713879 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.713883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.714675 (+ 792us) server_negotiation.cc:407] Connection header received
0808 08:34:25.714778 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.714781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.714837 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.714919 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.715349 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.716114 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.716995 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.717346 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.717420 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.719740 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.719745 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.719749 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.719780 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.721504 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.721956 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.721960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.721961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.722055 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.722363 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.722370 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.722372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.722606 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.722717 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.722951 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.723087 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:34:25.724099 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.713676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49336)
0808 08:34:25.713811 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.713827 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.713906 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.714222 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.714225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.714410 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:25.714515 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.714525 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.715463 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.715467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.716207 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.716217 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.716848 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.716851 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.716938 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.717419 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:25.717432 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:25.719450 (+ 2018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:25.721570 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.721575 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.721577 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.721931 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.723020 (+ 1089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.723023 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.723024 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.723111 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.723571 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:25.723574 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:25.723672 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.723758 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.723943 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":1}
I20260808 08:34:25.724146 17417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:25.724658 17421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.713689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49336 (local address 127.25.170.60:37025)
0808 08:34:25.714038 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.714041 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.714050 (+ 9us) server_negotiation.cc:407] Connection header received
0808 08:34:25.714075 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.714077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.714107 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.714164 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.714653 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.715366 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.716347 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.716727 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.716839 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.719585 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.719588 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.719591 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.719615 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.721434 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.722053 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.722056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.722059 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.722919 (+ 860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.723224 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.723227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.723228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.723451 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.724284 (+ 833us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.724400 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.724514 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292}
I20260808 08:34:25.725268 17340 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } attempt: 3
I20260808 08:34:25.725431 17266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.714477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37050 (local address 127.25.170.62:44057)
0808 08:34:25.714580 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.714584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.714871 (+ 287us) server_negotiation.cc:407] Connection header received
0808 08:34:25.714911 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.714913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.714964 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.715026 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.715811 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.716531 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.717595 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.718150 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.718264 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.720988 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.720992 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.720994 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.721018 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.722792 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.723484 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.723490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.723493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.723587 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.723882 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.723922 (+ 40us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.723924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.724136 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.724518 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.725144 (+ 626us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.725255 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 08:34:25.728142 17262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24: Bootstrap starting.
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
I20260808 08:34:25.730973 17262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:25.732348 17262 log.cc:824] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
I20260808 08:34:25.734678 17262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24: No bootstrap required, opened a new log
I20260808 08:34:25.735658 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.724623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49348)
0808 08:34:25.725025 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.725039 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.725108 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.725683 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.725690 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.726124 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:25.726209 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.726215 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.727070 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.727073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.727864 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.727873 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.728456 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.728459 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.728536 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.728985 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:25.728998 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:25.730492 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:25.732271 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.732275 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.732278 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.732526 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.732862 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.732866 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.732867 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.732964 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.735130 (+ 2166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:25.735133 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:25.735229 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.735346 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.735473 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344}
I20260808 08:34:25.736241 17421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.725036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49348 (local address 127.25.170.60:37025)
0808 08:34:25.725136 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.725140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.725154 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:34:25.725185 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.725188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.725231 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.725304 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.726344 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.726950 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.728025 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.728337 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.728444 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.730618 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.730622 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.730624 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.730645 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.732137 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.732630 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.732634 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.732638 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.732726 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.733389 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.733393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.733395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.734138 (+ 743us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.735138 (+ 1000us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.735976 (+ 838us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.736077 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 08:34:25 dist-test-slave-zkpd krb5kdc[17176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178065, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
I20260808 08:34:25.739387 17417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500: Bootstrap starting.
I20260808 08:34:25.739257 17262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } }
I20260808 08:34:25.739482 17262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bcfc7d5e12e4068acd29fd1f32f8b24, State: Initialized, Role: FOLLOWER
I20260808 08:34:25.739864 17262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } }
I20260808 08:34:25.740437 17424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } } }
I20260808 08:34:25.740716 17424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:25.741276 17262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:25.742113 17417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500: Neither blocks nor log segments found. Creating new log.
W20260808 08:34:25.742789 17214 tablet.cc:2369] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:25.743249 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.725744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:37025 (local address 127.0.0.1:49360)
0808 08:34:25.725898 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.725915 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.725989 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.732826 (+ 6837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.732829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.732981 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:25.733101 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.733107 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.735441 (+ 2334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.735444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.736209 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.736220 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.737404 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.737408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.737499 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.737976 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:25.737992 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:25.739402 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:25.741597 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.741601 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.741603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.741859 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.742213 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:25.742218 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:25.742221 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:25.742327 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:25.742796 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:25.742802 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:25.742903 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.742983 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.743104 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 08:34:25.743749 17417 log.cc:824] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:25.743805 17422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.732023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49360 (local address 127.25.170.60:37025)
0808 08:34:25.732423 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.732491 (+ 68us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.732507 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:34:25.732558 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.732563 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.732679 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.733208 (+ 529us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.733326 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.734903 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.736567 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.737262 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.737706 (+ 444us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.739615 (+ 1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.739619 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.739621 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.739645 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.741466 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.741976 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.741982 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.741987 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.742078 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.742461 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.742464 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.742468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.742676 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.743437 (+ 761us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.743511 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.743633 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":138,"threads_started":1}
I20260808 08:34:25.744459 17344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.726746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53662 (local address 127.25.170.61:46461)
0808 08:34:25.726845 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.726849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.726862 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:34:25.726895 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.726897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.726934 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.727012 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.727736 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.728424 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.729930 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.730159 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.730238 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.733116 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.733120 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.733123 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.733151 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.734923 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.735391 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.735395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.735396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.735481 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.735839 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.735842 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.735843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.736084 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.737073 (+ 989us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.737154 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.744285 (+ 7131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 08:34:25.745908 17417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500: No bootstrap required, opened a new log
I20260808 08:34:25.747172 17340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d: Bootstrap starting.
I20260808 08:34:25.749756 17340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:25.749934 17417 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } }
I20260808 08:34:25.750154 17417 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8284de6dc834180b252408e1eab5500, State: Initialized, Role: FOLLOWER
I20260808 08:34:25.746608 17192 master_runner.cc:186] Error getting master registration for 127.25.170.61:46461: OK, instance_id { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" instance_seqno: 1786178065472318 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:34:25.750437 17192 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:34:25.750455 17417 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } }
I20260808 08:34:25.750578 17340 log.cc:824] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:25.750870 17438 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } } }
I20260808 08:34:25.750988 17438 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:25.751699 17417 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:25.752928 17340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d: No bootstrap required, opened a new log
I20260808 08:34:25.753978 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 08:34:25.755020 17436 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:25.755095 17436 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:25.755328 17235 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37050
I20260808 08:34:25.755534 17235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 08:34:25.755663 17235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:25.756860 17235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } }
I20260808 08:34:25.757177 17340 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } }
I20260808 08:34:25.757395 17340 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3dad3f1b8a3459f95b7c5451a70b08d, State: Initialized, Role: FOLLOWER
I20260808 08:34:25.757771 17235 leader_election.cc:288] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [CANDIDATE]: Term 1 election: Requested vote from peers d3dad3f1b8a3459f95b7c5451a70b08d (127.25.170.61:46461), b8284de6dc834180b252408e1eab5500 (127.25.170.60:37025)
I20260808 08:34:25.757721 17340 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } }
I20260808 08:34:25.758361 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b8284de6dc834180b252408e1eab5500"
I20260808 08:34:25.758570 17390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:25.759868 17390 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bcfc7d5e12e4068acd29fd1f32f8b24 in term 1.
I20260808 08:34:25.760288 17209 leader_election.cc:302] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bcfc7d5e12e4068acd29fd1f32f8b24, b8284de6dc834180b252408e1eab5500; no voters:
I20260808 08:34:25.760571 17424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:25.760768 17424 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [term 1 LEADER]: Becoming Leader. State: Replica: 8bcfc7d5e12e4068acd29fd1f32f8b24, State: Running, Role: LEADER
I20260808 08:34:25.761075 17424 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } }
I20260808 08:34:25.759286 17347 master_runner.cc:186] Error getting master registration for 127.25.170.61:46461: OK, instance_id { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" instance_seqno: 1786178065472318 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:34:25.762466 17347 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:34:25.763603 17340 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:25.763638 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d"
I20260808 08:34:25.763885 17313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:25.765120 17313 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bcfc7d5e12e4068acd29fd1f32f8b24 in term 1.
I20260808 08:34:25.766350 17458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bcfc7d5e12e4068acd29fd1f32f8b24. Latest consensus state: current_term: 1 leader_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } } }
I20260808 08:34:25.766534 17458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:25.766983 17453 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } } }
I20260808 08:34:25.767107 17453 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:25.767669 17472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:25.768642 17472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260808 08:34:25.769162 17471 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:25.769289 17471 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:25.773789 17390 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [term 1 FOLLOWER]: Refusing update from remote peer 8bcfc7d5e12e4068acd29fd1f32f8b24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:25.774042 17313 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [term 1 FOLLOWER]: Refusing update from remote peer 8bcfc7d5e12e4068acd29fd1f32f8b24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:25.774479 17458 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:25.774626 17424 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:25.778272 17453 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bcfc7d5e12e4068acd29fd1f32f8b24. Latest consensus state: current_term: 1 leader_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } } }
I20260808 08:34:25.778393 17453 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:25.778988 17438 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bcfc7d5e12e4068acd29fd1f32f8b24. Latest consensus state: current_term: 1 leader_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } } }
I20260808 08:34:25.779102 17438 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 08:34:25.781677 17452 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:25.781744 17452 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:25.781713 17458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } } }
I20260808 08:34:25.781814 17458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:25.782881 17438 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } } }
I20260808 08:34:25.782979 17438 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:25.783792 17474 mvcc.cc:205] Tried to move back new op lower bound from 7316185357402120192 to 7316185357360578560. Current Snapshot: MvccSnapshot[applied={T|T < 7316185357402120192}]
I20260808 08:34:25.785392 17476 mvcc.cc:205] Tried to move back new op lower bound from 7316185357402120192 to 7316185357360578560. Current Snapshot: MvccSnapshot[applied={T|T < 7316185357402120192}]
I20260808 08:34:25.788573 17458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } } }
I20260808 08:34:25.788681 17458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:25.789758 17453 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcfc7d5e12e4068acd29fd1f32f8b24" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 44057 } } peers { permanent_uuid: "d3dad3f1b8a3459f95b7c5451a70b08d" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 46461 } } peers { permanent_uuid: "b8284de6dc834180b252408e1eab5500" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 37025 } } }
I20260808 08:34:25.789844 17472 catalog_manager.cc:1347] Generated new cluster ID: b4bd6401b3464145a387bfa8801e9cd5
I20260808 08:34:25.789877 17453 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:25.789892 17472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:25.790480 17475 mvcc.cc:205] Tried to move back new op lower bound from 7316185357402120192 to 7316185357360578560. Current Snapshot: MvccSnapshot[applied={T|T < 7316185357402120192}]
I20260808 08:34:25.806510 17422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.782216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49366 (local address 127.25.170.60:37025)
0808 08:34:25.782335 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.782341 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.788390 (+ 6049us) server_negotiation.cc:407] Connection header received
0808 08:34:25.788905 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.788909 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.788955 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.789004 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.793239 (+ 4235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.794052 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.795991 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.796359 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.796431 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.799577 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.799581 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.799583 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.799612 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.801370 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.804093 (+ 2723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.804096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.804098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.804188 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.804887 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.804890 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.804892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.805096 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.805221 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.806219 (+ 998us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.806354 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 08:34:25.808483 17266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.782678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37060 (local address 127.25.170.62:44057)
0808 08:34:25.782778 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.782783 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.788546 (+ 5763us) server_negotiation.cc:407] Connection header received
0808 08:34:25.789142 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.789145 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.789188 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.789257 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.791223 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.792051 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.795186 (+ 3135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.795532 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.795606 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.801875 (+ 6269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.801879 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.801882 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.801909 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.803570 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.804505 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.804509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.804511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.804590 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.805542 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.805545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.805547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.805749 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.805866 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.808188 (+ 2322us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.808333 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 08:34:25.813408 17344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.783306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53672 (local address 127.25.170.61:46461)
0808 08:34:25.783417 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.783421 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.789705 (+ 6284us) server_negotiation.cc:407] Connection header received
0808 08:34:25.800402 (+ 10697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.800406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.800459 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.800513 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.801398 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.802162 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.806186 (+ 4024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.806525 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.806597 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.809884 (+ 3287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:25.809888 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:25.809891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:25.809917 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:25.811559 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.812085 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.812088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.812090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.812171 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:25.812475 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:25.812478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:25.812479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:25.812694 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:25.812803 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.813160 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.813277 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:34:25.818121 17472 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:25.819259 17472 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:25.846161 17472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8bcfc7d5e12e4068acd29fd1f32f8b24: Generated new TSK 0
I20260808 08:34:25.847061 17472 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:34:25.880810 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:25.877547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53688 (local address 127.25.170.61:46461)
0808 08:34:25.877680 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.877685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.879684 (+ 1999us) server_negotiation.cc:407] Connection header received
0808 08:34:25.879916 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.879920 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.879973 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.880029 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.880667 (+ 638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53688: BlockingRecv error: recv got EOF from 127.0.0.1:53688 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 08:34:25.882189 17266 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:25.878382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37066 (local address 127.25.170.62:44057)
0808 08:34:25.878503 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.878507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.881301 (+ 2794us) server_negotiation.cc:407] Connection header received
0808 08:34:25.881471 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.881474 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.881522 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.881573 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.882067 (+ 494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37066: BlockingRecv error: recv got EOF from 127.0.0.1:37066 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 08:34:25.883606 17422 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:25.879095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49382 (local address 127.25.170.60:37025)
0808 08:34:25.879207 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.879212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.882638 (+ 3426us) server_negotiation.cc:407] Connection header received
0808 08:34:25.882892 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.882895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.882946 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.882996 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.883487 (+ 491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49382: BlockingRecv error: recv got EOF from 127.0.0.1:49382 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 08:34:25.888029 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:25.886491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53702 (local address 127.25.170.61:46461)
0808 08:34:25.886588 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.886592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.887054 (+ 462us) server_negotiation.cc:407] Connection header received
0808 08:34:25.887268 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.887272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.887347 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.887400 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.887884 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53702: BlockingRecv error: recv got EOF from 127.0.0.1:53702 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 08:34:25.892786 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:25.891373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53704 (local address 127.25.170.61:46461)
0808 08:34:25.891464 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.891468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.891980 (+ 512us) server_negotiation.cc:407] Connection header received
0808 08:34:25.892153 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.892156 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.892201 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.892249 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.892701 (+ 452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53704: BlockingRecv error: recv got EOF from 127.0.0.1:53704 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 08:34:25.898186 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:25.896749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53710 (local address 127.25.170.61:46461)
0808 08:34:25.896850 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.896854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.897343 (+ 489us) server_negotiation.cc:407] Connection header received
0808 08:34:25.897528 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.897531 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.897575 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.897620 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.898079 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53710: BlockingRecv error: recv got EOF from 127.0.0.1:53710 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 08:34:25.905758 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:25.904165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53726 (local address 127.25.170.61:46461)
0808 08:34:25.904293 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.904297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.904879 (+ 582us) server_negotiation.cc:407] Connection header received
0808 08:34:25.905077 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.905080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.905128 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.905178 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.905664 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53726: BlockingRecv error: recv got EOF from 127.0.0.1:53726 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 08:34:25.917208 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:25.915682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53730 (local address 127.25.170.61:46461)
0808 08:34:25.915779 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.915783 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.916331 (+ 548us) server_negotiation.cc:407] Connection header received
0808 08:34:25.916516 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.916520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.916568 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.916618 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.917111 (+ 493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53730: BlockingRecv error: recv got EOF from 127.0.0.1:53730 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 08:34:25.938223 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:25.936298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53734 (local address 127.25.170.61:46461)
0808 08:34:25.936421 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.936425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.937127 (+ 702us) server_negotiation.cc:407] Connection header received
0808 08:34:25.937343 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.937346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.937423 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.937478 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.938105 (+ 627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53734: BlockingRecv error: recv got EOF from 127.0.0.1:53734 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 08:34:25.975049 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:25.973146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53740 (local address 127.25.170.61:46461)
0808 08:34:25.973274 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.973278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.973987 (+ 709us) server_negotiation.cc:407] Connection header received
0808 08:34:25.974211 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.974217 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.974275 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.974329 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:25.974925 (+ 596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53740: BlockingRecv error: recv got EOF from 127.0.0.1:53740 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 08:34:26.043397 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:26.041862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53756 (local address 127.25.170.61:46461)
0808 08:34:26.042006 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.042010 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.042221 (+ 211us) server_negotiation.cc:407] Connection header received
0808 08:34:26.042489 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.042495 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.042566 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.042725 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:26.043273 (+ 548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53756: BlockingRecv error: recv got EOF from 127.0.0.1:53756 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 08:34:26.174662 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:26.173596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53766 (local address 127.25.170.61:46461)
0808 08:34:26.173748 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.173752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.173902 (+ 150us) server_negotiation.cc:407] Connection header received
0808 08:34:26.173975 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.173978 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.174032 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.174126 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:26.174556 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53766: BlockingRecv error: recv got EOF from 127.0.0.1:53766 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 08:34:26.434234 17344 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:26.433100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53770 (local address 127.25.170.61:46461)
0808 08:34:26.433275 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.433279 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.433347 (+ 68us) server_negotiation.cc:407] Connection header received
0808 08:34:26.433490 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.433492 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.433540 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.433614 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:26.434105 (+ 491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53770: BlockingRecv error: recv got EOF from 127.0.0.1:53770 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:34:26.770663 17471 catalog_manager.cc:1259] Loaded cluster ID: b4bd6401b3464145a387bfa8801e9cd5
I20260808 08:34:26.770767 17471 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d: loading cluster ID for follower catalog manager: success
I20260808 08:34:26.772521 17471 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d: acquiring CA information for follower catalog manager: success
I20260808 08:34:26.773733 17471 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d3dad3f1b8a3459f95b7c5451a70b08d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:34:26.782841 17452 catalog_manager.cc:1259] Loaded cluster ID: b4bd6401b3464145a387bfa8801e9cd5
I20260808 08:34:26.782897 17452 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500: loading cluster ID for follower catalog manager: success
I20260808 08:34:26.784411 17452 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500: acquiring CA information for follower catalog manager: success
I20260808 08:34:26.785415 17452 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b8284de6dc834180b252408e1eab5500: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:34:26.952704 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.948409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53772 (local address 127.25.170.61:46461)
0808 08:34:26.948668 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.948673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.948795 (+ 122us) server_negotiation.cc:407] Connection header received
0808 08:34:26.948993 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.948997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.949131 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.949256 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:26.949537 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.950081 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.950979 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.951214 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.951353 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:26.951710 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:26.952231 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:26.952390 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:26.952456 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 08:34:26.952512 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":91,"threads_started":1}
I20260808 08:34:26.959209 17563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.955574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49390 (local address 127.25.170.60:37025)
0808 08:34:26.955845 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.955852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.955869 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:34:26.955995 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.955998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.956110 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.956231 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:26.956457 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.956965 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.957793 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.958019 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.958150 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:26.958453 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:26.958831 (+ 378us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:26.958969 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:26.959007 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 08:34:26.959061 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":62,"threads_started":1}
I20260808 08:34:26.966576 17563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.962825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49406 (local address 127.25.170.60:37025)
0808 08:34:26.962966 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.962970 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.962983 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:34:26.963162 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.963168 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.963222 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.963288 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:26.963625 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.964453 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.965393 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.965623 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.965732 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:26.966099 (+ 367us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:26.966177 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:26.966250 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:26.966394 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 08:34:26.966457 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:34:26.967034 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.962393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53780 (local address 127.25.170.61:46461)
0808 08:34:26.962526 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.962530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.962758 (+ 228us) server_negotiation.cc:407] Connection header received
0808 08:34:26.962982 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.962986 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.963038 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.963089 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:26.963489 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.964334 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.965714 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.966028 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.966120 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:26.966488 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:26.966560 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:26.966609 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:26.966783 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 08:34:26.966846 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 08:34:26.968631 17569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.962381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37074 (local address 127.25.170.62:44057)
0808 08:34:26.962694 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.962712 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.963096 (+ 384us) server_negotiation.cc:407] Connection header received
0808 08:34:26.963301 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.963307 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.963515 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.963638 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:26.964047 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.964858 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.966122 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.966514 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.966623 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:26.967788 (+ 1165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:26.968158 (+ 370us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:26.968245 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:26.968356 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 08:34:26.968439 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":99,"threads_started":1}
I20260808 08:34:26.971917 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 17192
I20260808 08:34:26.981837 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 17269
I20260808 08:34:26.989113 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 17347
2026-08-08T08:34:26Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3123 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:27 dist-test-slave-zkpd krb5kdc[17575](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:27 dist-test-slave-zkpd krb5kdc[17575](info): set up 2 sockets
Aug 08 08:34:27 dist-test-slave-zkpd krb5kdc[17575](info): commencing operation
krb5kdc: starting...
W20260808 08:34:28.049758 26280 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/test-user.keytab.
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.170.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
Entry for principal kudu/127.25.170.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab.
I20260808 08:34:28.174468 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33741
--webserver_interface=127.25.170.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:46431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:33741,127.25.170.61:43215,127.25.170.60:39105
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:28.287047 17589 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:34:28.287384 17589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:28.287482 17589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:28.287564 17589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:28.291519 17589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:28.291607 17589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:28.291647 17589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:28.291684 17589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:28.291716 17589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:28.296846 17589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:33741,127.25.170.61:43215,127.25.170.60:39105
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.62.keytab
--principal=kudu/127.25.170.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.62:33741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.170.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:28.297894 17589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:28.298954 17589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:28.307447 17594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:28.307616 17597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:28.307487 17589 server_base.cc:1034] running on GCE node
W20260808 08:34:28.307459 17595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:28.308239 17589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:28.309332 17589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:28.310524 17589 hybrid_clock.cc:648] HybridClock initialized: now 1786178068310509 us; error 26 us; skew 500 ppm
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:28.313347 17589 init.cc:377] Logged in from keytab as kudu/127.25.170.62@KRBTEST.COM (short username kudu)
I20260808 08:34:28.314200 17589 webserver.cc:460] Webserver started at http://127.25.170.62:33145/ using document root <none> and password file <none>
I20260808 08:34:28.314704 17589 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:28.314765 17589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:28.314925 17589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:28.316941 17589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/data/instance:
uuid: "daad21a861014e299e002510a05a5f59"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-zkpd"
server_key: "78d5f589fb1aac1357c5239d9ed148cc"
server_key_iv: "d00e03858d6201a895034b4ca7b0851f"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.317457 17589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/wal/instance:
uuid: "daad21a861014e299e002510a05a5f59"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-zkpd"
server_key: "78d5f589fb1aac1357c5239d9ed148cc"
server_key_iv: "d00e03858d6201a895034b4ca7b0851f"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.321017 17589 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 08:34:28.323344 17604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:28.324646 17589 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:34:28.324790 17589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/wal
uuid: "daad21a861014e299e002510a05a5f59"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-zkpd"
server_key: "78d5f589fb1aac1357c5239d9ed148cc"
server_key_iv: "d00e03858d6201a895034b4ca7b0851f"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.324891 17589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:28.339389 17589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:28.342147 17589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:28.342372 17589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:28.349588 17589 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.62:33741
I20260808 08:34:28.349870 17660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.62:33741 every 8 connection(s)
I20260808 08:34:28.350528 17589 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:28.353231 17661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:28.356863 17661 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:28.360643 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 17589
I20260808 08:34:28.360764 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-0/wal/instance
I20260808 08:34:28.361052 26280 external_mini_cluster.cc:1428] Setting key 52ffdfa3d13086397def09b7b4fb62e6
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.61@KRBTEST.COM" created.
I20260808 08:34:28.372546 17664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.359495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39194 (local address 127.25.170.62:33741)
0808 08:34:28.359794 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.359805 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.359851 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:34:28.360550 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.360554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.360843 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.361038 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.361868 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.362757 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.363739 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.364207 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.364381 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.367052 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.367059 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.367071 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.367103 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.369023 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.369562 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.369568 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.369570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.369688 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.370074 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.370077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.370079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.370484 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.370641 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.371109 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.371418 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":205,"spinlock_wait_cycles":1408,"thread_start_us":65,"threads_started":1}
I20260808 08:34:28.372546 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.358832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33741 (local address 127.0.0.1:39194)
0808 08:34:28.359266 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.359309 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:28.360245 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:28.361037 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:28.361042 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:28.361483 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:28.361714 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.361727 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.362892 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.362901 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.363606 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.363616 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.364360 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.364364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.364457 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.365087 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:28.365104 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:28.366911 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:28.369168 (+ 2257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.369177 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.369188 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.369438 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.369820 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.369824 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.369826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.369948 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.370660 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:28.370668 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:28.370813 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 08:34:28.371036 (+ 223us) client_negotiation.cc:240] Negotiation successful
0808 08:34:28.371484 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":120,"spinlock_wait_cycles":2304,"thread_start_us":93,"threads_started":1}
I20260808 08:34:28.375089 17661 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:28.375869 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.375593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:43215 (local address 127.0.0.1:39256)
0808 08:34:28.375713 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.375810 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:43215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:34:28.376221 17605 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.170.61:43215: connect: Connection refused (error 111)
I20260808 08:34:28.377106 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.376917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:43215 (local address 127.0.0.1:39266)
0808 08:34:28.377016 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.377058 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:43215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 08:34:28.377337 17661 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.61:43215: Network error: Client connection negotiation failed: client connection to 127.25.170.61:43215: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab.
Entry for principal kudu/127.25.170.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab.
I20260808 08:34:28.388952 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.61:43215
--webserver_interface=127.25.170.61
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab
--principal=kudu/127.25.170.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:46431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:33741,127.25.170.61:43215,127.25.170.60:39105
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:34:28.426618 17661 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } attempt: 1
I20260808 08:34:28.427593 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.427277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:43215 (local address 127.0.0.1:39270)
0808 08:34:28.427445 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.427511 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:43215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 08:34:28.428481 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.428181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:43215 (local address 127.0.0.1:39280)
0808 08:34:28.428339 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.428414 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:43215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 08:34:28.428615 17661 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.61:43215: Network error: Client connection negotiation failed: client connection to 127.25.170.61:43215: connect: Connection refused (error 111)
I20260808 08:34:28.496802 17661 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } attempt: 2
I20260808 08:34:28.497649 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.497331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:43215 (local address 127.0.0.1:39290)
0808 08:34:28.497491 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.497570 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:43215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 08:34:28.498379 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.498153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:43215 (local address 127.0.0.1:39296)
0808 08:34:28.498281 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.498329 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.61:43215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:34:28.498514 17661 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.61:43215: Network error: Client connection negotiation failed: client connection to 127.25.170.61:43215: connect: Connection refused (error 111)
W20260808 08:34:28.505633 17668 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:34:28.505918 17668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:28.505980 17668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:28.506059 17668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:28.510030 17668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:28.510108 17668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:28.510151 17668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:28.510188 17668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:28.510221 17668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:28.515479 17668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:33741,127.25.170.61:43215,127.25.170.60:39105
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.61.keytab
--principal=kudu/127.25.170.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.61:43215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.170.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:28.516517 17668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:28.517529 17668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:28.526006 17675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:28.526015 17677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:28.526063 17674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:28.526352 17668 server_base.cc:1034] running on GCE node
I20260808 08:34:28.526926 17668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:28.528000 17668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:28.529160 17668 hybrid_clock.cc:648] HybridClock initialized: now 1786178068529136 us; error 34 us; skew 500 ppm
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:28.532104 17668 init.cc:377] Logged in from keytab as kudu/127.25.170.61@KRBTEST.COM (short username kudu)
I20260808 08:34:28.533002 17668 webserver.cc:460] Webserver started at http://127.25.170.61:33779/ using document root <none> and password file <none>
I20260808 08:34:28.533552 17668 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:28.533612 17668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:28.533897 17668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:28.535967 17668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/data/instance:
uuid: "85a743b9fd6e4f6da67bd225e224cd97"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-zkpd"
server_key: "2e8bfd4bd88f67106c21cca809321478"
server_key_iv: "ece05795af7f31a49292cd5f8d1b8edd"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.536607 17668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/wal/instance:
uuid: "85a743b9fd6e4f6da67bd225e224cd97"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-zkpd"
server_key: "2e8bfd4bd88f67106c21cca809321478"
server_key_iv: "ece05795af7f31a49292cd5f8d1b8edd"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.540189 17668 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:34:28.542518 17684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:28.543664 17668 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:34:28.543764 17668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/wal
uuid: "85a743b9fd6e4f6da67bd225e224cd97"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-zkpd"
server_key: "2e8bfd4bd88f67106c21cca809321478"
server_key_iv: "ece05795af7f31a49292cd5f8d1b8edd"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.543933 17668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:28.554438 17668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:28.557531 17668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:28.557735 17668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:28.564970 17668 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.61:43215
I20260808 08:34:28.565254 17738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.61:43215 every 8 connection(s)
I20260808 08:34:28.565980 17668 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/data/info.pb
I20260808 08:34:28.568733 17739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:28.572366 17739 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:28.576054 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 17668
I20260808 08:34:28.576180 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-1/wal/instance
I20260808 08:34:28.576501 26280 external_mini_cluster.cc:1428] Setting key 04a1d761f2a54d3a460be68223183e52
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.170.60@KRBTEST.COM; defaulting to no policy
I20260808 08:34:28.587088 17664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.574155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39202 (local address 127.25.170.62:33741)
0808 08:34:28.574313 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.574318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.575175 (+ 857us) server_negotiation.cc:407] Connection header received
0808 08:34:28.576128 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.576132 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.576206 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.576316 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.577491 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.578347 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.580186 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.580424 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.580509 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.583379 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.583383 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.583385 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.583409 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.584932 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.585472 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.585477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.585479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.585564 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.585904 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.585909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.585910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.586093 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.586204 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.586776 (+ 572us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.586914 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:34:28.588004 17741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.574569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33741 (local address 127.0.0.1:39202)
0808 08:34:28.575010 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.575052 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:28.575839 (+ 787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:28.576474 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:28.576480 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:28.576867 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:28.577318 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.577342 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.578515 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.578520 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.580054 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.580068 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.580588 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.580595 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.580839 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.581558 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:28.581588 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:28.583203 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:28.585066 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.585072 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.585102 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.585366 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.585663 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.585666 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.585668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.585807 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.586203 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:28.586211 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:28.586529 (+ 318us) client_negotiation.cc:769] Sending connection context
0808 08:34:28.586718 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 08:34:28.587035 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":121,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.170.60@KRBTEST.COM" created.
I20260808 08:34:28.589401 17739 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:28.589670 17661 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } attempt: 3
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
I20260808 08:34:28.600801 17741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.589972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:43215 (local address 127.0.0.1:39308)
0808 08:34:28.590985 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.590999 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:28.591075 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:28.591297 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:28.591300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:28.591463 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:28.591565 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.591571 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.592574 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.592579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.593573 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.593589 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.594321 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.594328 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.594467 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.594914 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:28.594928 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:28.596671 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:28.598988 (+ 2317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.598992 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.598994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.599282 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.599617 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.599620 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.599621 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.599698 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.600328 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:28.600330 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:28.600437 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 08:34:28.600544 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 08:34:28.600677 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":947,"mutex_wait_us":7,"spinlock_wait_cycles":2432}
I20260808 08:34:28.601263 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.590048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:43215 (local address 127.0.0.1:39320)
0808 08:34:28.590229 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.590247 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:28.590326 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:28.590900 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:28.590905 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:28.591116 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:28.591241 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.591250 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.592610 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.592615 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.593141 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.593149 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.593898 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.593901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.594019 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.594520 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:28.594540 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:28.596074 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:28.599496 (+ 3422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.599499 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.599501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.599768 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.600096 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.600099 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.600101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.600193 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.600621 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:28.600624 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:28.600722 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 08:34:28.600837 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:34:28.601120 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260808 08:34:28.601344 17743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.590089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39320 (local address 127.25.170.61:43215)
0808 08:34:28.590451 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.590464 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.590490 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:34:28.590538 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.590546 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.590751 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.590911 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.591395 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.592493 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.593283 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.593771 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.593887 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.596240 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.596251 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.596266 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.596296 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.599381 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.599871 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.599874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.599875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.600007 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.600317 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.600337 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.600339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.600523 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.600612 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.600920 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.601049 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":214,"server-negotiator.queue_time_us":244,"thread_start_us":155,"threads_started":1}
I20260808 08:34:28.601058 17744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.590429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39308 (local address 127.25.170.61:43215)
0808 08:34:28.590743 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.590762 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.591044 (+ 282us) server_negotiation.cc:407] Connection header received
0808 08:34:28.591142 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.591147 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.591188 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.591280 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.591672 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.592456 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.593726 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.594166 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.594284 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.596831 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.596835 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.596837 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.596867 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.598860 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.599392 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.599398 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.599400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.599514 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.599796 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.599802 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.599807 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.600227 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.600370 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.600667 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.600883 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":218,"thread_start_us":100,"threads_started":1}
I20260808 08:34:28.603349 17739 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:28.603482 17661 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:28.604110 17741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.603794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44358)
0808 08:34:28.603985 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.604060 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 08:34:28.604242 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.603992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44362)
0808 08:34:28.604100 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.604149 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:34:28.604341 17685 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
I20260808 08:34:28.605199 17741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.604997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44378)
0808 08:34:28.605099 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.605144 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:34:28.605391 17739 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:39105: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
I20260808 08:34:28.605489 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.605156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44382)
0808 08:34:28.605366 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.605423 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260808 08:34:28.605599 17661 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:39105: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.170.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab.
Entry for principal kudu/127.25.170.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab.
I20260808 08:34:28.606990 26280 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
/tmp/dist-test-tasklAkZqe/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.60:39105
--webserver_interface=127.25.170.60
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab
--principal=kudu/127.25.170.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.170.20:46431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.170.62:33741,127.25.170.61:43215,127.25.170.60:39105
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:34:28.636782 17661 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } attempt: 1
I20260808 08:34:28.637677 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.637374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44398)
0808 08:34:28.637530 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.637596 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 08:34:28.638491 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.638279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44412)
0808 08:34:28.638390 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.638441 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:34:28.638660 17661 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:39105: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
I20260808 08:34:28.654660 17739 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } attempt: 1
I20260808 08:34:28.655452 17741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.655170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44418)
0808 08:34:28.655309 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.655377 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 08:34:28.656250 17741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.656030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44434)
0808 08:34:28.656140 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.656192 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 08:34:28.656383 17739 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:39105: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
I20260808 08:34:28.713824 17661 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } attempt: 2
I20260808 08:34:28.714694 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.714368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44446)
0808 08:34:28.714522 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.714583 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 08:34:28.715449 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.715229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44450)
0808 08:34:28.715348 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.715398 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 08:34:28.715571 17661 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:39105: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
W20260808 08:34:28.722229 17747 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:34:28.722545 17747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:28.722623 17747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:28.722698 17747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 08:34:28.724532 17739 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } attempt: 2
I20260808 08:34:28.725208 17741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.724955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44452)
0808 08:34:28.725080 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.725136 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 08:34:28.725914 17741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.725698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44458)
0808 08:34:28.725805 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.725858 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:34:28.726046 17739 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.170.60:39105: Network error: Client connection negotiation failed: client connection to 127.25.170.60:39105: connect: Connection refused (error 111)
W20260808 08:34:28.726924 17747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:28.727010 17747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:28.727072 17747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:28.727145 17747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:28.727182 17747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:28.732538 17747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.170.20:46431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.170.62:33741,127.25.170.61:43215,127.25.170.60:39105
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/krb5kdc/kudu_127.25.170.60.keytab
--principal=kudu/127.25.170.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.170.60:39105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.170.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 07:34:22 UTC on ccycloud.quasar-bqoudn.root.comops.site
build id 4574264
I20260808 08:34:28.733640 17747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:28.734685 17747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:28.743275 17753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:28.743211 17752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:28.743234 17755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:28.743522 17747 server_base.cc:1034] running on GCE node
I20260808 08:34:28.744271 17747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:28.745301 17747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:28.746493 17747 hybrid_clock.cc:648] HybridClock initialized: now 1786178068746479 us; error 25 us; skew 500 ppm
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:28.749452 17747 init.cc:377] Logged in from keytab as kudu/127.25.170.60@KRBTEST.COM (short username kudu)
I20260808 08:34:28.750351 17747 webserver.cc:460] Webserver started at http://127.25.170.60:33103/ using document root <none> and password file <none>
I20260808 08:34:28.750897 17747 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:28.750990 17747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:28.751224 17747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:28.753250 17747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/data/instance:
uuid: "d6a4ce992a074cac88a53c44a5408472"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-zkpd"
server_key: "50415d0518fb84c8b10e8045ab3d18de"
server_key_iv: "9809821cd49651fa61a4079d7a71f4fd"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.753825 17747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/wal/instance:
uuid: "d6a4ce992a074cac88a53c44a5408472"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-zkpd"
server_key: "50415d0518fb84c8b10e8045ab3d18de"
server_key_iv: "9809821cd49651fa61a4079d7a71f4fd"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.757400 17747 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:34:28.759713 17762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:28.760927 17747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:34:28.761068 17747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/data,/tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/wal
uuid: "d6a4ce992a074cac88a53c44a5408472"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-zkpd"
server_key: "50415d0518fb84c8b10e8045ab3d18de"
server_key_iv: "9809821cd49651fa61a4079d7a71f4fd"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.761181 17747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:28.770895 17747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:28.774119 17747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:28.774324 17747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:28.781461 17747 rpc_server.cc:307] RPC server started. Bound to: 127.25.170.60:39105
I20260808 08:34:28.781752 17817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.170.60:39105 every 8 connection(s)
I20260808 08:34:28.782438 17747 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/data/info.pb
I20260808 08:34:28.783241 26280 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu as pid 17747
I20260808 08:34:28.783367 26280 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklAkZqe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786177786507378-26280-0/minicluster-data/master-2/wal/instance
I20260808 08:34:28.783682 26280 external_mini_cluster.cc:1428] Setting key 7a6b772f32d1aee29b24aa6f811732f4
I20260808 08:34:28.785712 17818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:28.789963 17818 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
I20260808 08:34:28.798465 17821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.785082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44468 (local address 127.25.170.60:39105)
0808 08:34:28.785487 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.785503 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.785539 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:34:28.786239 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.786259 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.786594 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.786873 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.787819 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.788875 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.790024 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.790548 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.790666 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.793462 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.793470 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.793484 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.793516 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.795357 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.795841 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.795846 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.795853 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.796028 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.796377 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.796382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.796386 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.796767 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.796924 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.797293 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.797574 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":141,"threads_started":1}
I20260808 08:34:28.802264 17664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.791971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39208 (local address 127.25.170.62:33741)
0808 08:34:28.792142 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.792146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.792502 (+ 356us) server_negotiation.cc:407] Connection header received
0808 08:34:28.792677 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.792681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.792731 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.792817 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.793524 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.794195 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.795470 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.795675 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.795780 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.798112 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.798116 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.798118 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.798144 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.800416 (+ 2272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.800958 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.800962 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.800964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.801055 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.801350 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.801355 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.801357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.801531 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.801641 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.801987 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.802095 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:34:28.802281 17822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.791879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.62:33741 (local address 127.0.0.1:39208)
0808 08:34:28.792385 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.792425 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:28.792558 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:28.792875 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:28.792880 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:28.793237 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:28.793398 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.793407 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.794320 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.794323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.795337 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.795349 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.795794 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.795799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.795957 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.796458 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:28.796471 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:28.797968 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:28.800527 (+ 2559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.800538 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.800543 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.800876 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.801159 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.801163 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.801165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.801257 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.801641 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:28.801649 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:28.801768 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 08:34:28.801906 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 08:34:28.802086 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":168,"threads_started":1}
I20260808 08:34:28.803397 17818 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.62@KRBTEST.COM
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
I20260808 08:34:28.809818 17823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.800609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39218 (local address 127.25.170.62:33741)
0808 08:34:28.800933 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.800939 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.800951 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:34:28.800982 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.800984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.801017 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.801121 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.801694 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.802203 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.803232 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.803452 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.803589 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.806149 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.806153 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.806155 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.806179 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.808008 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.808504 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.808507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.808508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.808579 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.808869 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.808872 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.808873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.809101 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.809301 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.809516 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.809629 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":130,"threads_started":1}
I20260808 08:34:28.812595 17744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.804074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39328 (local address 127.25.170.61:43215)
0808 08:34:28.804235 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.804240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.804385 (+ 145us) server_negotiation.cc:407] Connection header received
0808 08:34:28.804503 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.804505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.804544 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.804608 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.805094 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.805620 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.806592 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.806909 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.807026 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.809121 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.809125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.809128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.809158 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.810903 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.811321 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.811325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.811326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.811415 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.811733 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.811736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.811738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.811985 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.812074 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.812393 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.812488 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:34:28.812676 17822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.804175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.61:43215 (local address 127.0.0.1:39328)
0808 08:34:28.804299 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.804313 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:28.804407 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:28.804659 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:28.804663 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:28.804856 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:28.804977 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.804984 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.805773 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.805776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.806461 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.806473 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.807051 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.807056 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.807170 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.807529 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:28.807544 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:28.808990 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:28.811012 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.811015 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.811017 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.811212 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.811525 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.811530 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.811531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.811626 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.812084 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:28.812089 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:28.812201 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 08:34:28.812325 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 08:34:28.812514 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 08:34:28.813375 17818 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:34:28.814721 17661 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } attempt: 3
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.170.61@KRBTEST.COM
I20260808 08:34:28.817189 17739 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } attempt: 3
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.60@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
I20260808 08:34:28.821802 17743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.811345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39342 (local address 127.25.170.61:43215)
0808 08:34:28.811444 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.811448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.811704 (+ 256us) server_negotiation.cc:407] Connection header received
0808 08:34:28.811786 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.811791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.811854 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.811963 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.812720 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.813503 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.814535 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.814870 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.814975 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.817644 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.817647 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.817650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.817674 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.819602 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.820198 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.820201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.820203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.820302 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.820662 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.820667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.820670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.820906 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.821098 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.821501 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.821619 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.62@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
I20260808 08:34:28.824476 17821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.813964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44470 (local address 127.25.170.60:39105)
0808 08:34:28.814055 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.814059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.814071 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:34:28.814101 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.814104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.814138 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.814214 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.814565 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.815221 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.816412 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.816749 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.816855 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.819383 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.819388 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.819394 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.819421 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.821211 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.821668 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.821671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.821673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.821741 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.822038 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.822042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.822043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.822222 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.822311 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.823297 (+ 986us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.824013 (+ 716us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 08:34:28 dist-test-slave-zkpd krb5kdc[17575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.170.61@KRBTEST.COM for kudu/127.25.170.60@KRBTEST.COM
I20260808 08:34:28.824833 17822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.813830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44470)
0808 08:34:28.813909 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.813920 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:28.813976 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:28.814237 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:28.814238 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:28.814367 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:28.814433 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.814437 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.815308 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.815314 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.816283 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.816298 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.816874 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.816881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.816977 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.817674 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:28.817691 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:28.819238 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:28.821330 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.821333 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.821335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.821568 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.821841 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.821847 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.821848 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.821931 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.822373 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:28.822376 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:28.822473 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 08:34:28.823432 (+ 959us) client_negotiation.cc:240] Negotiation successful
0808 08:34:28.824655 (+ 1223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":1137}
I20260808 08:34:28.827003 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.815493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44486)
0808 08:34:28.815681 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.815695 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:28.815774 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:28.816234 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:28.816236 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:28.816447 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:28.816542 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.816549 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.817502 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.817506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.820124 (+ 2618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.820136 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.821081 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.821084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.821172 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.821618 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:28.821632 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:28.823055 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:28.825300 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.825303 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.825304 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.825553 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.825869 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.825872 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.825874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.825971 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.826482 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:28.826486 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:28.826586 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 08:34:28.826698 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 08:34:28.826828 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119}
I20260808 08:34:28.827100 17824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.815261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44486 (local address 127.25.170.60:39105)
0808 08:34:28.816045 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.816052 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.816063 (+ 11us) server_negotiation.cc:407] Connection header received
0808 08:34:28.816089 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.816090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.816120 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.816217 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.816667 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.817407 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.820262 (+ 2855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.820866 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.820959 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.823198 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.823202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.823204 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.823233 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.825123 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.825654 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.825658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.825659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.825754 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.826090 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.826093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.826095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.826381 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.826483 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.826762 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.826938 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":329,"thread_start_us":87,"threads_started":1}
I20260808 08:34:28.828619 26280 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:28.828728 17818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472: Bootstrap starting.
I20260808 08:34:28.830353 17661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59: Bootstrap starting.
I20260808 08:34:28.829989 17634 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "daad21a861014e299e002510a05a5f59"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39218
I20260808 08:34:28.831534 17818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:28.832440 17818 log.cc:824] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:28.832890 17661 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:28.833665 17661 log.cc:824] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:28.834720 17818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472: No bootstrap required, opened a new log
I20260808 08:34:28.835618 17661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59: No bootstrap required, opened a new log
I20260808 08:34:28.838650 17661 raft_consensus.cc:348] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } }
I20260808 08:34:28.838899 17661 raft_consensus.cc:729] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daad21a861014e299e002510a05a5f59, State: Initialized, Role: FOLLOWER
I20260808 08:34:28.839392 17818 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } }
I20260808 08:34:28.839691 17818 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6a4ce992a074cac88a53c44a5408472, State: Initialized, Role: FOLLOWER
I20260808 08:34:28.839602 17661 consensus_queue.cc:260] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } }
I20260808 08:34:28.839962 17741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.817542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.170.60:39105 (local address 127.0.0.1:44492)
0808 08:34:28.818205 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:28.818223 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:28.818317 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:28.818712 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:28.818715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:28.818920 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:28.819017 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.819023 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.821073 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.821076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.821899 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:28.821910 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.822599 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.822603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:28.822703 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.823597 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:28.823613 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:28.824980 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:28.827282 (+ 2302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.827285 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.827287 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.827530 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.827868 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:28.827871 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:28.827873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:28.828015 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:28.839311 (+ 11296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:28.839315 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:28.839452 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 08:34:28.839576 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 08:34:28.839752 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565}
I20260808 08:34:28.840070 17818 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } }
I20260808 08:34:28.840346 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.817756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44492 (local address 127.25.170.60:39105)
0808 08:34:28.818046 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.818055 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.818295 (+ 240us) server_negotiation.cc:407] Connection header received
0808 08:34:28.818412 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.818417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.818459 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.818530 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.820191 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.820952 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.822057 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.822458 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.822903 (+ 445us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.825149 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.825154 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.825160 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.825188 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.827093 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.827674 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.827677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.827679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.827759 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.834225 (+ 6466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.834228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.834229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.839151 (+ 4922us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.839255 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.839707 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.839976 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":85,"threads_started":1}
I20260808 08:34:28.840998 17661 sys_catalog.cc:564] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:28.841101 17634 raft_consensus.cc:482] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 08:34:28.841244 17634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:28.841256 17818 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:28.842463 17634 raft_consensus.cc:504] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } }
I20260808 08:34:28.843319 17739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97: Bootstrap starting.
I20260808 08:34:28.843412 17634 leader_election.cc:288] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [CANDIDATE]: Term 1 election: Requested vote from peers 85a743b9fd6e4f6da67bd225e224cd97 (127.25.170.61:43215), d6a4ce992a074cac88a53c44a5408472 (127.25.170.60:39105)
W20260808 08:34:28.843817 17610 tablet.cc:2369] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:28.843595 17829 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } } }
I20260808 08:34:28.844376 17829 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:28.845250 17828 sys_catalog.cc:455] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } } }
I20260808 08:34:28.845371 17828 sys_catalog.cc:458] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:28.847949 17791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "daad21a861014e299e002510a05a5f59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d6a4ce992a074cac88a53c44a5408472"
I20260808 08:34:28.848169 17791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [term 0 FOLLOWER]: Advancing to term 1
W20260808 08:34:28.848768 17848 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:28.848850 17848 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:28.849591 17791 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daad21a861014e299e002510a05a5f59 in term 1.
I20260808 08:34:28.846895 17589 master_runner.cc:186] Error getting master registration for 127.25.170.61:43215: OK, instance_id { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" instance_seqno: 1786178068562921 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:34:28.850672 17589 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:34:28.850967 17605 leader_election.cc:302] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6a4ce992a074cac88a53c44a5408472, daad21a861014e299e002510a05a5f59; no voters:
I20260808 08:34:28.851310 17828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:28.851565 17828 raft_consensus.cc:686] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [term 1 LEADER]: Becoming Leader. State: Replica: daad21a861014e299e002510a05a5f59, State: Running, Role: LEADER
I20260808 08:34:28.851950 17828 consensus_queue.cc:237] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } }
I20260808 08:34:28.852557 17739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:28.849833 17747 master_runner.cc:186] Error getting master registration for 127.25.170.61:43215: OK, instance_id { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" instance_seqno: 1786178068562921 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:34:28.853103 17747 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:34:28.853668 17739 log.cc:824] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:28.854065 17828 sys_catalog.cc:455] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daad21a861014e299e002510a05a5f59. Latest consensus state: current_term: 1 leader_uuid: "daad21a861014e299e002510a05a5f59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } } }
I20260808 08:34:28.854194 17828 sys_catalog.cc:458] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:28.854637 17864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:28.856040 17739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97: No bootstrap required, opened a new log
I20260808 08:34:28.857780 17864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:28.859421 17743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.846824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39354 (local address 127.25.170.61:43215)
0808 08:34:28.846937 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.846941 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.849733 (+ 2792us) server_negotiation.cc:407] Connection header received
0808 08:34:28.850038 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.850042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.850121 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.850182 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.851250 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.852048 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.853307 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.853636 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.853741 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.855678 (+ 1937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.855681 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.855684 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.855711 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.857434 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.857964 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.857968 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.857970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.858057 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.858397 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.858400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.858402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.858620 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.858727 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.859132 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.859254 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 08:34:28.863397 17739 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } }
I20260808 08:34:28.863632 17739 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85a743b9fd6e4f6da67bd225e224cd97, State: Initialized, Role: FOLLOWER
I20260808 08:34:28.863979 17739 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } }
I20260808 08:34:28.865520 17739 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:28.865562 17711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "daad21a861014e299e002510a05a5f59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "85a743b9fd6e4f6da67bd225e224cd97"
I20260808 08:34:28.866103 17711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:28.867679 17711 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daad21a861014e299e002510a05a5f59 in term 1.
I20260808 08:34:28.868451 17791 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [term 1 FOLLOWER]: Refusing update from remote peer daad21a861014e299e002510a05a5f59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:28.869311 17712 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [term 1 FOLLOWER]: Refusing update from remote peer daad21a861014e299e002510a05a5f59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:28.865819 17867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } } }
I20260808 08:34:28.870708 17828 consensus_queue.cc:1035] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:28.870797 17867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:28.871136 17828 consensus_queue.cc:1035] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:28.873479 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.848621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44506 (local address 127.25.170.60:39105)
0808 08:34:28.848722 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.848725 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.858457 (+ 9732us) server_negotiation.cc:407] Connection header received
0808 08:34:28.858695 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.858699 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.858754 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.858813 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.861367 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.862192 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.864279 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.864640 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.864727 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.867801 (+ 3074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.867805 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.867808 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.867836 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.869707 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.870446 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.870450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.870452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.870544 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.870915 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.870918 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.870920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.871147 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.871313 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.873193 (+ 1880us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.873329 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 08:34:28.874265 17823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.846618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39228 (local address 127.25.170.62:33741)
0808 08:34:28.846871 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.846876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.860118 (+ 13242us) server_negotiation.cc:407] Connection header received
0808 08:34:28.860302 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.860305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.860359 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.860413 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.861322 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.862149 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.865129 (+ 2980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.865486 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.865572 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.869070 (+ 3498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.869073 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.869076 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.869101 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.870953 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.871743 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.871763 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.871768 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.871870 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.872250 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.872254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.872256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.872469 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.872591 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.874003 (+ 1412us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.874121 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184}
I20260808 08:34:28.874745 17829 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daad21a861014e299e002510a05a5f59. Latest consensus state: current_term: 1 leader_uuid: "daad21a861014e299e002510a05a5f59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } } }
I20260808 08:34:28.874926 17829 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:28.875089 17867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daad21a861014e299e002510a05a5f59. Latest consensus state: current_term: 1 leader_uuid: "daad21a861014e299e002510a05a5f59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } } }
I20260808 08:34:28.875211 17867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 08:34:28.879420 17883 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:28.879532 17883 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:28.886624 17860 sys_catalog.cc:455] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "daad21a861014e299e002510a05a5f59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } } }
I20260808 08:34:28.886755 17860 sys_catalog.cc:458] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:28.887837 17829 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "daad21a861014e299e002510a05a5f59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } } }
I20260808 08:34:28.887976 17829 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:28.888181 17866 mvcc.cc:205] Tried to move back new op lower bound from 7316185370073251840 to 7316185370021756928. Current Snapshot: MvccSnapshot[applied={T|T < 7316185370073251840}]
I20260808 08:34:28.891435 17880 mvcc.cc:205] Tried to move back new op lower bound from 7316185370073251840 to 7316185370021756928. Current Snapshot: MvccSnapshot[applied={T|T < 7316185370073251840 or (T in {7316185370073251840})}]
I20260808 08:34:28.896525 17828 sys_catalog.cc:455] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "daad21a861014e299e002510a05a5f59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } } }
I20260808 08:34:28.896646 17828 sys_catalog.cc:458] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:28.897439 17864 catalog_manager.cc:1347] Generated new cluster ID: b1ee4fd210b54357931c322c16e90c82
I20260808 08:34:28.897500 17864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:28.897763 17867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "daad21a861014e299e002510a05a5f59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daad21a861014e299e002510a05a5f59" member_type: VOTER last_known_addr { host: "127.25.170.62" port: 33741 } } peers { permanent_uuid: "85a743b9fd6e4f6da67bd225e224cd97" member_type: VOTER last_known_addr { host: "127.25.170.61" port: 43215 } } peers { permanent_uuid: "d6a4ce992a074cac88a53c44a5408472" member_type: VOTER last_known_addr { host: "127.25.170.60" port: 39105 } } }
I20260808 08:34:28.897889 17867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:28.907979 17879 mvcc.cc:205] Tried to move back new op lower bound from 7316185370073251840 to 7316185370021756928. Current Snapshot: MvccSnapshot[applied={T|T < 7316185370073251840}]
I20260808 08:34:28.916685 17864 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:28.917832 17864 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:28.930181 17864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P daad21a861014e299e002510a05a5f59: Generated new TSK 0
I20260808 08:34:28.931046 17864 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:34:28.963739 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:28.960452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39358 (local address 127.25.170.61:43215)
0808 08:34:28.960599 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.960603 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.962599 (+ 1996us) server_negotiation.cc:407] Connection header received
0808 08:34:28.962803 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.962807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.962871 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.962926 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.963594 (+ 668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39358: BlockingRecv error: recv got EOF from 127.0.0.1:39358 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 08:34:28.966149 17823 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:28.960996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39232 (local address 127.25.170.62:33741)
0808 08:34:28.961148 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.961153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.964372 (+ 3219us) server_negotiation.cc:407] Connection header received
0808 08:34:28.964591 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.964594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.964647 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.964699 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.966023 (+ 1324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39232: BlockingRecv error: recv got EOF from 127.0.0.1:39232 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 08:34:28.967037 17825 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:28.961733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44510 (local address 127.25.170.60:39105)
0808 08:34:28.961870 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.961875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.965427 (+ 3552us) server_negotiation.cc:407] Connection header received
0808 08:34:28.965648 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.965651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.965700 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.965749 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.966917 (+ 1168us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44510: BlockingRecv error: recv got EOF from 127.0.0.1:44510 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 08:34:28.971871 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:28.970244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39364 (local address 127.25.170.61:43215)
0808 08:34:28.970350 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.970354 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.970882 (+ 528us) server_negotiation.cc:407] Connection header received
0808 08:34:28.971118 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.971121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.971210 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.971263 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.971760 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39364: BlockingRecv error: recv got EOF from 127.0.0.1:39364 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 08:34:28.977021 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:28.975558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39376 (local address 127.25.170.61:43215)
0808 08:34:28.975653 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.975657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.976209 (+ 552us) server_negotiation.cc:407] Connection header received
0808 08:34:28.976381 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.976384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.976431 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.976479 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.976934 (+ 455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39376: BlockingRecv error: recv got EOF from 127.0.0.1:39376 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 08:34:28.982575 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:28.981209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39380 (local address 127.25.170.61:43215)
0808 08:34:28.981302 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.981306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.981738 (+ 432us) server_negotiation.cc:407] Connection header received
0808 08:34:28.981933 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.981938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.981985 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.982032 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.982489 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39380: BlockingRecv error: recv got EOF from 127.0.0.1:39380 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 08:34:28.990664 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:28.989006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39384 (local address 127.25.170.61:43215)
0808 08:34:28.989164 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.989169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.989680 (+ 511us) server_negotiation.cc:407] Connection header received
0808 08:34:28.989895 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.989899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.989953 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.990006 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.990545 (+ 539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39384: BlockingRecv error: recv got EOF from 127.0.0.1:39384 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260808 08:34:29.002841 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:29.001230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39392 (local address 127.25.170.61:43215)
0808 08:34:29.001341 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:29.001345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:29.001864 (+ 519us) server_negotiation.cc:407] Connection header received
0808 08:34:29.002073 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:29.002076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:29.002132 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:29.002183 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:29.002713 (+ 530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39392: BlockingRecv error: recv got EOF from 127.0.0.1:39392 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 08:34:29.023547 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:29.021696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39396 (local address 127.25.170.61:43215)
0808 08:34:29.021844 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:29.021849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:29.022428 (+ 579us) server_negotiation.cc:407] Connection header received
0808 08:34:29.022654 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:29.022658 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:29.022714 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:29.022770 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:29.023395 (+ 625us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39396: BlockingRecv error: recv got EOF from 127.0.0.1:39396 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 08:34:29.060220 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:29.058461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39400 (local address 127.25.170.61:43215)
0808 08:34:29.058580 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:29.058585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:29.059126 (+ 541us) server_negotiation.cc:407] Connection header received
0808 08:34:29.059332 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:29.059337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:29.059393 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:29.059444 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:29.060101 (+ 657us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39400: BlockingRecv error: recv got EOF from 127.0.0.1:39400 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 08:34:29.128111 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:29.126926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39414 (local address 127.25.170.61:43215)
0808 08:34:29.127121 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:29.127126 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:29.127213 (+ 87us) server_negotiation.cc:407] Connection header received
0808 08:34:29.127340 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:29.127343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:29.127393 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:29.127468 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:29.127978 (+ 510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39414: BlockingRecv error: recv got EOF from 127.0.0.1:39414 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260808 08:34:29.259343 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:29.258137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39428 (local address 127.25.170.61:43215)
0808 08:34:29.258353 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:29.258358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:29.258431 (+ 73us) server_negotiation.cc:407] Connection header received
0808 08:34:29.258561 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:29.258564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:29.258621 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:29.258698 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:29.259179 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39428: BlockingRecv error: recv got EOF from 127.0.0.1:39428 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260808 08:34:29.518591 17743 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:29.517520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39436 (local address 127.25.170.61:43215)
0808 08:34:29.517656 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:29.517660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:29.517733 (+ 73us) server_negotiation.cc:407] Connection header received
0808 08:34:29.517887 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:29.517889 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:29.517940 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:29.518022 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:29.518451 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39436: BlockingRecv error: recv got EOF from 127.0.0.1:39436 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:34:29.850167 17848 catalog_manager.cc:1259] Loaded cluster ID: b1ee4fd210b54357931c322c16e90c82
I20260808 08:34:29.850281 17848 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472: loading cluster ID for follower catalog manager: success
I20260808 08:34:29.852095 17848 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472: acquiring CA information for follower catalog manager: success
I20260808 08:34:29.853266 17848 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d6a4ce992a074cac88a53c44a5408472: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:34:29.880915 17883 catalog_manager.cc:1259] Loaded cluster ID: b1ee4fd210b54357931c322c16e90c82
I20260808 08:34:29.881016 17883 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97: loading cluster ID for follower catalog manager: success
I20260808 08:34:29.882663 17883 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97: acquiring CA information for follower catalog manager: success
I20260808 08:34:29.883818 17883 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 85a743b9fd6e4f6da67bd225e224cd97: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:34:30.037107 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:30.032916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39446 (local address 127.25.170.61:43215)
0808 08:34:30.033183 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:30.033190 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:30.033312 (+ 122us) server_negotiation.cc:407] Connection header received
0808 08:34:30.033516 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:30.033520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:30.033662 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:30.033803 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:30.034083 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.034619 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.035510 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.035743 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.035869 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:30.036239 (+ 370us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:30.036685 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:30.036842 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:30.036890 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 08:34:30.036946 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":72,"threads_started":1}
I20260808 08:34:30.043998 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:30.040204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44522 (local address 127.25.170.60:39105)
0808 08:34:30.040468 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:30.040471 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:30.040487 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:34:30.040567 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:30.040569 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:30.040768 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:30.040870 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:30.041068 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.041599 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.042586 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.042873 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.042952 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:30.043206 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:30.043634 (+ 428us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:30.043726 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:30.043783 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 08:34:30.043829 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":84,"threads_started":1}
I20260808 08:34:30.051445 17970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:30.046882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39234 (local address 127.25.170.62:33741)
0808 08:34:30.047424 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:30.047429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:30.047444 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:34:30.047541 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:30.047548 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:30.047707 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:30.047852 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:30.048149 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.048974 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.050013 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.050241 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.050357 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:30.050693 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:30.051006 (+ 313us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:30.051103 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:30.051199 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 08:34:30.051251 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":87,"threads_started":1}
I20260808 08:34:30.051939 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:30.046931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39460 (local address 127.25.170.61:43215)
0808 08:34:30.047051 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:30.047055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:30.047254 (+ 199us) server_negotiation.cc:407] Connection header received
0808 08:34:30.048072 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:30.048076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:30.048138 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:30.048210 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:30.048444 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.049007 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.050424 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.050779 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.050852 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:30.051426 (+ 574us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:30.051493 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:30.051540 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:30.051704 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 08:34:30.051777 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 08:34:30.052070 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:30.047347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44530 (local address 127.25.170.60:39105)
0808 08:34:30.047453 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:30.047458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:30.047567 (+ 109us) server_negotiation.cc:407] Connection header received
0808 08:34:30.047656 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:30.047658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:30.047766 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:30.047853 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:30.048161 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.048974 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.050424 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.050755 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.050854 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:30.051399 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:30.051472 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:30.051541 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:30.051876 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 08:34:30.051946 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 08:34:30.054824 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 17589
I20260808 08:34:30.064458 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 17668
I20260808 08:34:30.072120 26280 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklAkZqe/build/debug/bin/kudu with pid 17747
2026-08-08T08:34:30Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3082 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6205 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (283560 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST